netbilgim.com
robots.txt
Robots Exclusion Standard data for netbilgim.com
Resource Scan
Scan Details
| Site Domain | netbilgim.com |
| Base Domain | netbilgim.com |
| Scan Status | Ok |
| Last Scan | 2024-09-19T20:35:57+00:00 |
| Next Scan | 2024-09-26T20:35:57+00:00 |
Last Scan
| Scanned | 2024-09-19T20:35:57+00:00 |
| URL | https://netbilgim.com/robots.txt |
| Domain IPs | 94.102.2.170 |
| Response IP | 94.102.2.170 |
| Found | Yes |
| Hash | 050db7b42258a1976dfaaf2b6a4053d7d4831cb9c41fed3b4f6446428471531b |
| SimHash | 6c71ba251411 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*ref%3D* |
| Disallow | /*?ref= |
| Disallow | /cgi-bin/ |
| Disallow | /api/ |
| Disallow | /inquiry.html?d=* |
| Disallow | /archive.php |
Other Records
| Field | Value |
|---|---|
| sitemap | /sitemap.xml |
| sitemap | /newsmap.xml |