birdlife.no
robots.txt

Robots Exclusion Standard data for birdlife.no

Resource Scan

Scan Details

Site Domain birdlife.no
Base Domain birdlife.no
Scan Status Ok
Last Scan2025-10-20T17:06:24+00:00
Next Scan 2025-11-19T17:06:24+00:00

Last Scan

Scanned2025-10-20T17:06:24+00:00
URL https://birdlife.no/robots.txt
Domain IPs 194.63.249.215, 2a01:5b40:0:4a04:0:db52:505c:b837
Response IP 194.63.249.215
Found Yes
Hash bb8fbbc72394ec965913e1c64378860b601ea6be5a5b3ac662cbaada2a4862cb
SimHash cb5d5040be18

Groups

*

Rule Path
Disallow /jscripts/

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /