maddam.no
robots.txt

Robots Exclusion Standard data for maddam.no

Resource Scan

Scan Details

Site Domain maddam.no
Base Domain maddam.no
Scan Status Ok
Last Scan2024-11-07T14:06:04+00:00
Next Scan 2024-12-07T14:06:04+00:00

Last Scan

Scanned2024-11-07T14:06:04+00:00
URL https://maddam.no/robots.txt
Domain IPs 104.21.72.210, 172.67.154.253, 2606:4700:3030::ac43:9afd, 2606:4700:3032::6815:48d2
Response IP 104.21.72.210
Found Yes
Hash b025a2912eab8698e68949d5470fab3cf999da206524af515cdeae392edf4d89
SimHash 50167970c48a

Groups

ahrefsbot
blexbot
baiduspider
bytedance
bytespider
ccbot
chatgpt-user
claude-web
claudebot
dataforseobot
diffbot
domainstatsbot
gptbot
httrack
httrack 3.0
mj12bot
mail.ru_bot
offline explorer
perplexitybot
petalbot
seokicks
scrapy
screaming frog seo spider
semrushbot
sogou web spider
wellknownbot
xenu
yandexbot
youbot
zoominfobot
anthropic-ai
archive.org_bot
cohere-ai
dotbot
ia_archiver
rogerbot
barkrowler
brightedge crawler
cocolyzebot
hypestat
linkdexbot
online-webceo-bot
serpstatbot
sitecheckerbotcrawler
seolizer
seobilitybot
senutobot

Rule Path
Disallow /

Warnings

  • 1 invalid line.