netwerk24.com
robots.txt
Robots Exclusion Standard data for netwerk24.com
Resource Scan
Scan Details
| Site Domain | netwerk24.com |
| Base Domain | netwerk24.com |
| Scan Status | Ok |
| Last Scan | 2024-06-26T22:08:18+00:00 |
| Next Scan | 2024-07-03T22:08:18+00:00 |
Last Scan
| Scanned | 2024-06-26T22:08:18+00:00 |
| URL | https://netwerk24.com/robots.txt |
| Redirect | https://www.netwerk24.com/robots.txt |
| Redirect Domain | www.netwerk24.com |
| Redirect Base | netwerk24.com |
| Domain IPs | 104.19.231.81, 104.19.232.81, 2606:4700::6813:e751, 2606:4700::6813:e851 |
| Redirect IPs | 104.19.231.81, 104.19.232.81, 2606:4700::6813:e751, 2606:4700::6813:e851 |
| Response IP | 104.19.232.81 |
| Found | Yes |
| Hash | 7e337c2a7614102e55c36230051f4799e2943f8cbe26a2da09ae862543965033 |
| SimHash | 741c5951edb1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | */cricket/test/ |
| Allow | */cricketworldcup2019/Test/ |
| Disallow | /toets/ |
| Disallow | */toets/* |
| Disallow | /test/ |
| Disallow | */_test/* |
| Disallow | */testpolar/* |
| Disallow | */test/* |
| Disallow | /xArchive/Archive/Illegal-liquor-export-20010319 |
| Disallow | /.well-known/ |
| Disallow | /assetlinks.json |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.netwerk24.com/sitemap |
Warnings
- 2 invalid lines.
Comments