gbnews.com
robots.txt
Robots Exclusion Standard data for gbnews.com
Resource Scan
Scan Details
| Site Domain | gbnews.com |
| Base Domain | gbnews.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-02-27T08:23:16+00:00 |
| Next Scan | 2024-05-27T08:23:16+00:00 |
Last Successful Scan
| Scanned | 2023-05-04T07:09:03+00:00 |
| URL | https://gbnews.com/robots.txt |
| Redirect | https://www.gbnews.com/robots.txt |
| Redirect Domain | www.gbnews.com |
| Redirect Base | gbnews.com |
| Domain IPs | 54.243.223.181, 54.243.223.182 |
| Redirect IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Response IP | 199.232.45.91 |
| Found | Yes |
| Hash | b6b2191313bb1e9618500fa217226e1d4124607f83d057e8e237e532a646d397 |
| SimHash | 004dfd11cad0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /core/* |
| Disallow | /r/* |
| Allow | /r/kappa/api/* |
| Disallow | /mnt/* |
| Disallow | /radioplayer?* |
| Disallow | /?q=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gbnews.com/sitemap.xml |
| sitemap | https://www.gbnews.com/sitemap_news.xml |
| sitemap | https://www.gbnews.com/r/kappa/api/v1/reader/news_1.xml |
| sitemap | https://www.gbnews.com/sitemap_video.xml |
| sitemap | https://www.gbnews.com/sitemap_sections.xml |
| sitemap | https://www.gbnews.com/feeds/sitemaps/sitemap_1.xml |
| sitemap | https://www.gbnews.com/feeds/sitemaps/news_1.xml |
| sitemap | https://www.gbnews.com/feeds/editorial.rss |
| sitemap | https://www.gbnews.com/feeds/sport.rss |
| sitemap | https://www.gbnews.com/feeds/celebrity.rss |
| sitemap | https://www.gbnews.com/feeds/travel.rss |
| sitemap | https://www.gbnews.com/feeds/money.rss |
| sitemap | https://www.gbnews.com/feeds/weather.rss |
| sitemap | https://www.gbnews.com/feeds/politics.rss |
| sitemap | https://www.gbnews.com/feeds/royal.rss |
| sitemap | https://www.gbnews.com/feeds/opinion.rss |
| sitemap | https://www.gbnews.com/feeds/news.rss |
Warnings
- 2 invalid lines.