howtoforge.com
robots.txt
Robots Exclusion Standard data for howtoforge.com
Resource Scan
Scan Details
| Site Domain | howtoforge.com |
| Base Domain | howtoforge.com |
| Scan Status | Ok |
| Last Scan | 2024-05-05T05:40:34+00:00 |
| Next Scan | 2024-05-12T05:40:34+00:00 |
Last Scan
| Scanned | 2024-05-05T05:40:34+00:00 |
| URL | https://howtoforge.com/robots.txt |
| Domain IPs | 104.26.2.165, 104.26.3.165, 172.67.68.93, 2606:4700:20::681a:2a5, 2606:4700:20::681a:3a5, 2606:4700:20::ac43:445d |
| Response IP | 172.67.68.93 |
| Found | Yes |
| Hash | e0cae840dfb89ee2546c2fed882cfa66a291e98652a399eff2764648e184cae2 |
| SimHash | 52119171ca91 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /help/privacy-policy |
| Disallow | /imprint |
| Disallow | /imprint/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.howtoforge.com/sitemap.xml.gz |
Warnings
- 4 invalid lines.