benew.no
robots.txt
Robots Exclusion Standard data for benew.no
Resource Scan
Scan Details
| Site Domain | benew.no |
| Base Domain | benew.no |
| Scan Status | Ok |
| Last Scan | 2025-09-20T01:13:37+00:00 |
| Next Scan | 2025-10-20T01:13:37+00:00 |
Last Scan
| Scanned | 2025-09-20T01:13:37+00:00 |
| URL | https://benew.no/robots.txt |
| Domain IPs | 52.17.124.116, 54.195.240.169 |
| Response IP | 54.195.240.169 |
| Found | Yes |
| Hash | 51d6c729b37769db63c983e93ad1861969fcb60296680897a1c645eac835be1b |
| SimHash | e510bb636051 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /kontrollpanel |
| Disallow | /search |
| Disallow | /search_result |
| Disallow | /search_result?* |
| Disallow | /cookie_usage |
| Disallow | /htmlpackingmanifest.php |
| Disallow | /htmlpackingmanifest.php?* |
| Disallow | /htmlpackingslip_new.php |
| Disallow | /htmlpackingslip_new.php?* |
| Disallow | /htmlpackingslip.php |
| Disallow | /htmlpackingslip.php?* |
| Disallow | /htmlpackingslip_meters.php |
| Disallow | /htmlpackingslip_meters.php?* |
| Disallow | /order_confirmation.php |
| Disallow | /order_confirmation.php?* |
| Disallow | /pdfinvoice.php |
| Disallow | /pdfinvoice.php?* |
| Disallow | /pdf_kredittnota.php |
| Disallow | /pdf_kredittnota.php?* |
| Disallow | /pdf_angreskjema.php |
| Disallow | /pdf_angreskjema.php?* |
| Disallow | /htmlreturnsform.php |
| Disallow | /htmlreturnsform.php?* |
| Disallow | /htmlinvoice_new.php |
| Disallow | /htmlinvoice_new.php?* |
| Disallow | /htmlgiftcard.php |
| Disallow | /htmlgiftcard.php?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |