powerlook.in
robots.txt

Robots Exclusion Standard data for powerlook.in

Resource Scan

Scan Details

Site Domain powerlook.in
Base Domain powerlook.in
Scan Status Ok
Last Scan2024-06-18T06:19:17+00:00
Next Scan 2024-07-18T06:19:17+00:00

Last Scan

Scanned2024-06-18T06:19:17+00:00
URL https://powerlook.in/robots.txt
Redirect https://www.powerlook.in/robots.txt
Redirect Domain www.powerlook.in
Redirect Base powerlook.in
Domain IPs 2600:9000:2721:3000:17:8264:5000:93a1, 2600:9000:2721:5c00:17:8264:5000:93a1, 2600:9000:2721:8000:17:8264:5000:93a1, 2600:9000:2721:8200:17:8264:5000:93a1, 2600:9000:2721:c600:17:8264:5000:93a1, 2600:9000:2721:e800:17:8264:5000:93a1, 2600:9000:2721:ee00:17:8264:5000:93a1, 2600:9000:2721:f200:17:8264:5000:93a1, 3.165.102.108, 3.165.102.51, 3.165.102.65, 3.165.102.96
Redirect IPs 108.157.254.36, 108.157.254.5, 108.157.254.61, 108.157.254.91, 2600:9000:2753:3600:8:1c07:d400:93a1, 2600:9000:2753:400:8:1c07:d400:93a1, 2600:9000:2753:4600:8:1c07:d400:93a1, 2600:9000:2753:7400:8:1c07:d400:93a1, 2600:9000:2753:9000:8:1c07:d400:93a1, 2600:9000:2753:9c00:8:1c07:d400:93a1, 2600:9000:2753:b400:8:1c07:d400:93a1, 2600:9000:2753:d400:8:1c07:d400:93a1
Response IP 108.157.254.61
Found Yes
Hash c4e31b2c5152166b84b54d51b9348464d215ae5e4bd6aa72369a47b0b527df4d
SimHash 680dd811f592

Groups

*

Rule Path
Disallow /shopping-bag
Disallow /login?redirectTo=%2Faccount%2Fmywishlist
Disallow /*?

adsbot-google

Rule Path
Disallow /shopping-bag
Disallow /login?redirectTo=%2Faccount%2Fmywishlist
Disallow /*?

googlebot

Rule Path
Disallow /shopping-bag
Disallow /login?redirectTo=%2Faccount%2Fmywishlist
Disallow /*?

googlebot-image

Rule Path
Disallow /shopping-bag
Disallow /login?redirectTo=%2Faccount%2Fmywishlist
Disallow /*?

boardreader

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrush

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.powerlook.in/sitemap.xml

Comments

  • Google bots specific rules
  • Blocking specific bots
  • Slow down other bots