elpunt.cat
robots.txt
Robots Exclusion Standard data for elpunt.cat
Resource Scan
Scan Details
| Site Domain | elpunt.cat |
| Base Domain | elpunt.cat |
| Scan Status | Ok |
| Last Scan | 2024-11-12T13:27:42+00:00 |
| Next Scan | 2024-11-19T13:27:42+00:00 |
Last Scan
| Scanned | 2024-11-12T13:27:42+00:00 |
| URL | https://elpunt.cat/robots.txt |
| Redirect | https://www.elpuntavui.cat//robots.txt |
| Redirect Domain | www.elpuntavui.cat |
| Redirect Base | elpuntavui.cat |
| Domain IPs | 104.21.8.149, 172.67.130.138, 2606:4700:3034::ac43:828a, 2606:4700:3037::6815:895 |
| Redirect IPs | 104.26.8.180, 104.26.9.180, 172.67.72.199, 2606:4700:20::681a:8b4, 2606:4700:20::681a:9b4, 2606:4700:20::ac43:48c7 |
| Response IP | 104.26.8.180 |
| Found | Yes |
| Hash | 556e2bf73af0c2edd45b9faba428bade9d5f5b3a9cbf17bba0dbf19672b21cf4 |
| SimHash | 4228554837ba |
Groups
aihitbot
alphaseobot
alphaseobot-sa
blexbot
careerbot
cliqzbot
megaindex
owlin
owlin bot
owlin bot v. 3.0
queryseekerspider
seokicks-robot
semrush
semrushbot
sogou
tkbot
vagabondo
wbsearchbot
dotbot
grapeshot
icjobs
linkdexbot
magpie-crawler
proximic
scrapy
scrapybot
sentibot
adidxbot
ahrefsbot
blp_bbot
blp_bbot/0.1
baiduspider
baiduspider+
baiduspider-image+
bingpreview
exabot/3.0
mj12bot
naverbot
semrushbot
snapbot/1.0
yandex
yandexbot
yeti
youdaobot
dtsearchspider
ichiro
magpie-crawler
moget
sogou spider
screaming frog seo spider
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media2/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates2/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /cgi-bin/ |
| Disallow | /serveirestringit.html |
| Disallow | /*.raw |
| Disallow | /edicio/ |
| Disallow | /*/*.raw |
| Disallow | /*/*.raw?* |
| Disallow | *.jpg?ESBORRAM* |
Comments