miningmagazine.com
robots.txt
Robots Exclusion Standard data for miningmagazine.com
Resource Scan
Scan Details
| Site Domain | miningmagazine.com |
| Base Domain | miningmagazine.com |
| Scan Status | Ok |
| Last Scan | 2024-10-20T02:54:58+00:00 |
| Next Scan | 2024-11-19T02:54:58+00:00 |
Last Scan
| Scanned | 2024-10-20T02:54:58+00:00 |
| URL | https://miningmagazine.com/robots.txt |
| Redirect | https://www.miningmagazine.com/robots.txt |
| Redirect Domain | www.miningmagazine.com |
| Redirect Base | miningmagazine.com |
| Domain IPs | 138.68.117.89 |
| Redirect IPs | 138.68.117.89 |
| Response IP | 138.68.117.89 |
| Found | Yes |
| Hash | 13f8422573e41a0bb17f033dedb1bdb61b1f76ff4b33990970bd34999bbb22cf |
| SimHash | 28759d5440a9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /feeds/rss/search |
| Disallow | /digital_assets/ |
| Disallow | /pdf/ |
| Disallow | /mining-magazine-intelligence-digitalisation-report-2021-epublication |
| Disallow | /mining-magazine-intelligence-automation-report-2021-epublication |
| Disallow | /mining-magazine-intelligence-future-fleets-report-2022-epublication |
| Disallow | /mining-magazine-intelligence-digitalisation-report-2020-epublication |
| Disallow | /mining-magazine-intelligence-automation-report-2020 |
| Disallow | /mining-magazine-intelligence-future-fleets-report-2021 |
| Disallow | /mining-magazine-intelligence-digitalisation-report-2022-epublication |
| Disallow | /mining-magazine-intelligence-future-fleets-report-2023-epublication |
| Disallow | /mining-magazine-intelligence-exploration-report-2023-epublication |
| Disallow | /verify-site-login |
| Disallow | /v45ftaswytvoli |
| Disallow | /mining-magazine-intelligence-automation-report-2022 |
| Disallow | /mining-magazine-intelligence-exploration-report-2022 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.miningmagazine.com/sitemap_index.xml |
| sitemap | https://www.miningmagazine.com/news-sitemap.xml |
| sitemap | https://www.miningmagazine.com/videositemap.xml |
Comments