bastaerbjudanden.se
robots.txt

Robots Exclusion Standard data for bastaerbjudanden.se

Resource Scan

Scan Details

Site Domain bastaerbjudanden.se
Base Domain bastaerbjudanden.se
Scan Status Ok
Last Scan2024-11-03T20:58:47+00:00
Next Scan 2024-11-10T20:58:47+00:00

Last Scan

Scanned2024-11-03T20:58:47+00:00
URL https://bastaerbjudanden.se/robots.txt
Redirect https://www.bastaerbjudanden.se/robots.txt
Redirect Domain www.bastaerbjudanden.se
Redirect Base bastaerbjudanden.se
Domain IPs 167.71.6.229, 2a03:b0c0:2:f0::250:4001
Redirect IPs 167.71.6.229, 2a03:b0c0:2:f0::250:4001
Response IP 167.71.6.229
Found Yes
Hash 81deed5b69755fb811c136db9ba969f01297809ac91bf95b41d65fd98b6d2f95
SimHash b8680a75edb2

Groups

*

Rule Path
Disallow /api/
Disallow /site/
Disallow /exit/
Disallow /brochure/brochure-page/
Disallow */?login-token=
Disallow */user-admin/*
Disallow */nove-heslo/
Disallow */detalj/*
Disallow */?page=
Disallow */offers/*
Disallow */detail/*
Disallow */detaljer/*
Disallow /27957108/*
Disallow /js/joined/bub.min.js

Other Records

Field Value
sitemap https://www.bastaerbjudanden.se/sitemap_index.xml