clickenergyni.com
robots.txt

Robots Exclusion Standard data for clickenergyni.com

Resource Scan

Scan Details

Site Domain clickenergyni.com
Base Domain clickenergyni.com
Scan Status Ok
Last Scan2024-06-23T00:34:54+00:00
Next Scan 2024-07-23T00:34:54+00:00

Last Scan

Scanned2024-06-23T00:34:54+00:00
URL https://clickenergyni.com/robots.txt
Domain IPs 164.177.145.143
Response IP 164.177.145.143
Found Yes
Hash ec5694e3ba533caf48c827323b4062b4861f5f9c5ed6da266841de2d4cbe2281
SimHash 524d8ed27611

Groups

*

Rule Path
Disallow /dashboard/

*

Rule Path
Disallow /dashboard/*

*

Rule Path
Disallow /getattachment/*

*

Rule Path
Disallow /getattachment/

*
mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/*

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

yandex

Rule Path Comment
Disallow / prohibits crawling for the entire site

repolookoutbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aihitdata

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /getattachment/*

Other Records

Field Value
sitemap https://www.clickenergyni.com/googlesitemap.xml

Comments

  • User-Agent: Googlebot
  • Allow: *.css