bigislandtimes.com
robots.txt
Robots Exclusion Standard data for bigislandtimes.com
Resource Scan
Scan Details
| Site Domain | bigislandtimes.com |
| Base Domain | bigislandtimes.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-19T22:29:02+00:00 |
| Next Scan | 2024-11-20T22:29:02+00:00 |
Last Successful Scan
| Scanned | 2024-11-12T20:52:02+00:00 |
| URL | https://bigislandtimes.com/robots.txt |
| Domain IPs | 3.82.80.110 |
| Response IP | 34.236.176.60 |
| Found | Yes |
| Hash | ccfb4dc5832eb02f3d5bb9ef108eb99bfc63f025f84bc693d7434c9f8e43551c |
| SimHash | 6e56d185cf35 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*.json |
| Disallow | /v.js |
| Disallow | /ad.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bigislandtimes.com/sitemaps/bigislandtimes/sitemap.xml.gz |
| sitemap | https://bigislandtimes.com/sitemaps/bigislandtimes/sitemap_news.xml.gz |
Comments