reklambladerbjudanden.se
robots.txt

Robots Exclusion Standard data for reklambladerbjudanden.se

Resource Scan

Scan Details

Site Domain reklambladerbjudanden.se
Base Domain reklambladerbjudanden.se
Scan Status Ok
Last Scan2024-09-25T19:00:24+00:00
Next Scan 2024-10-02T19:00:24+00:00

Last Scan

Scanned2024-09-25T19:00:24+00:00
URL https://reklambladerbjudanden.se/robots.txt
Redirect https://www.reklambladerbjudanden.se/robots.txt
Redirect Domain www.reklambladerbjudanden.se
Redirect Base reklambladerbjudanden.se
Domain IPs 104.21.77.108, 172.67.207.45, 2606:4700:3034::ac43:cf2d, 2606:4700:3035::6815:4d6c
Redirect IPs 108.157.254.103, 108.157.254.17, 108.157.254.43, 108.157.254.65, 2600:9000:2753:3000:12:ae15:f6c0:93a1, 2600:9000:2753:4000:12:ae15:f6c0:93a1, 2600:9000:2753:400:12:ae15:f6c0:93a1, 2600:9000:2753:5400:12:ae15:f6c0:93a1, 2600:9000:2753:600:12:ae15:f6c0:93a1, 2600:9000:2753:b000:12:ae15:f6c0:93a1, 2600:9000:2753:bc00:12:ae15:f6c0:93a1, 2600:9000:2753:d600:12:ae15:f6c0:93a1
Response IP 108.157.254.103
Found Yes
Hash ce7bea426ac637a6c51933e0eb4b5f23fa3f50008e94155bb3ad9351655e2e69
SimHash e50f4e30c491

Groups

*

Rule Path
Allow /
Disallow /sokning/*
Disallow /shopping-list/
Disallow /click-out/
Disallow /index.php/click-out/
Disallow /admin/
Disallow /cdn-cgi/
Disallow /erbjudanden/*?sort=relevance&page=*&*
Allow /erbjudanden/*?sort=relevance&page=*
Disallow /erbjudanden/*?page=*&*
Allow /erbjudanden/*?page=*
Disallow /erbjudanden/*?*
Disallow /varumarken/*?page=*&*
Allow /varumarken/*?page=*
Disallow /varumarken/*?*
Disallow /butiker/*?page=*&*
Allow /butiker/*?page=*
Disallow /butiker/*?*
Disallow /stader/*?page=*&*
Allow /stader/*?page=*
Disallow /stader/*?*
Disallow /nyaste-reklamblad?page=*&*
Allow /nyaste-reklamblad?page=*
Disallow /nyaste-reklamblad?*
Disallow /snart-utganga-reklamblad?page=*&*
Allow /snart-utganga-reklamblad?page=*
Disallow /snart-utganga-reklamblad?*
Disallow /populara-reklamblad?page=*&*
Allow /populara-reklamblad?page=*
Disallow /populara-reklamblad?*
Disallow /rekommenderade-reklamblad?page=*&*
Allow /rekommenderade-reklamblad?page=*
Disallow /rekommenderade-reklamblad?*
Disallow /nyaste-erbjudandet?page=*&*
Allow /nyaste-erbjudandet?page=*
Disallow /nyaste-erbjudandet?*
Disallow /snart-utgagna-erbjudanden?page=*&*
Allow /snart-utgagna-erbjudanden?page=*
Disallow /snart-utgagna-erbjudanden?*
Disallow /populara-erbjudanden?page=*&*
Allow /populara-erbjudanden?page=*
Disallow /populara-erbjudanden?*
Disallow /rekommenderade-erbjudanden?page=*&*
Allow /rekommenderade-erbjudanden?page=*
Disallow /rekommenderade-erbjudanden?*

adsbot-google

Rule Path
Disallow /click-out/
Disallow /admin/

*
adsbot-google

Rule Path
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /cdn-cgi/images/trace/
Disallow /cdn-cgi/rum
Disallow /cdn-cgi/scripts/
Disallow /cdn-cgi/styles/
Disallow /cdn-cgi/zaraz/

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
mj12bot
ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.reklambladerbjudanden.se/sitemap.xml