noclick.se
robots.txt

Robots Exclusion Standard data for noclick.se

Resource Scan

Scan Details

Site Domain noclick.se
Base Domain noclick.se
Scan Status Ok
Last Scan2025-12-08T08:49:09+00:00
Next Scan 2025-12-09T08:49:09+00:00

Last Scan

Scanned2025-12-08T08:49:09+00:00
URL https://noclick.se/robots.txt
Redirect https://www.noclick.se/robots.txt
Redirect Domain www.noclick.se
Redirect Base noclick.se
Domain IPs 104.21.8.243, 172.67.130.197, 2606:4700:3030::ac43:82c5, 2606:4700:3035::6815:8f3
Redirect IPs 104.21.8.243, 172.67.130.197, 2606:4700:3030::ac43:82c5, 2606:4700:3035::6815:8f3
Response IP 172.67.130.197
Found Yes
Hash 0ed00518470a48682609ff317c826a05c579db8e625b218eba2348eeed93bdaa
SimHash 721cc38bc3a0

Groups

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

seokicks-robot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

java

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

atomic_email_hunter

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/3.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/4.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/5.0; +http://www.baidu.com/search/spider.html)
baiduspider/2.0
baiduspider/3.0
baiduspider/4.0
baiduspider/5.0

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

anthropic-ai
claude-web
applebot-extended
bytespider
chatgpt-user
gptbot
cohere-ai
diffbot
facebookbot
googleother
google-extended
imagesiftbot
perplexitybot
omigilibot
omigili
omgili

Rule Path
Allow /

ccbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.noclick.se/sitemap.xml

Comments

  • Block SEOkicks
  • Block SISTRIX
  • Block Searchmetrics Bot
  • Block Baidu
  • Block SoGou
  • Block Youdao
  • Block DataForSeo