supersaver.no
robots.txt
Robots Exclusion Standard data for supersaver.no
Resource Scan
Scan Details
Site Domain | supersaver.no |
Base Domain | supersaver.no |
Scan Status | Ok |
Last Scan | 2024-07-02T16:05:15+00:00 |
Next Scan | 2024-07-09T16:05:15+00:00 |
Last Scan
Scanned | 2024-07-02T16:05:15+00:00 |
URL | https://www.supersaver.no/robots.txt |
Domain IPs | 23.210.102.86 |
Response IP | 104.110.76.126 |
Found | Yes |
Hash | 89bdea9fed5cdfc25ac89d3eaab5f38cabebb92c2a8a3c5a6fb835d330ef89ba |
SimHash | 28455600f872 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax* |
Disallow | /*.action$ |
Disallow | /rf/mobile-travel-plan/* |
Disallow | /from/ |
Disallow | /top/ |
Disallow | /rf/start |
Disallow | /rf/result |
Disallow | /rf/traveler-details |
Disallow | /rf/payment |
Disallow | /rf/order-login |
Disallow | /order-ntd-generate-ref/ |
Disallow | /payment |
Disallow | /sourcefiles/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.supersaver.no/sitemap.xml |