blueclean.in
robots.txt

Robots Exclusion Standard data for blueclean.in

Resource Scan

Scan Details

Site Domain blueclean.in
Base Domain blueclean.in
Scan Status Ok
Last Scan2025-03-27T14:34:24+00:00
Next Scan 2025-04-26T14:34:24+00:00

Last Scan

Scanned2025-03-27T14:34:24+00:00
URL https://blueclean.in/robots.txt
Redirect https://www.blueclean.in/robots.txt
Redirect Domain www.blueclean.in
Redirect Base blueclean.in
Domain IPs 13.35.202.31, 13.35.202.40, 13.35.202.5, 13.35.202.87
Redirect IPs 2600:9000:2200:1400:14:abfe:b640:93a1, 2600:9000:2200:7600:14:abfe:b640:93a1, 2600:9000:2200:7e00:14:abfe:b640:93a1, 2600:9000:2200:8e00:14:abfe:b640:93a1, 2600:9000:2200:aa00:14:abfe:b640:93a1, 2600:9000:2200:b600:14:abfe:b640:93a1, 2600:9000:2200:d200:14:abfe:b640:93a1, 2600:9000:2200:f600:14:abfe:b640:93a1, 54.192.18.108, 54.192.18.17, 54.192.18.68, 54.192.18.74
Response IP 3.171.198.47
Found Yes
Hash a6b39b9bd5b62d2a3bcf1521489f2d33c06832ebdd293e408eec33b36069d57e
SimHash a11550748f10

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout
Disallow /gmc-and-refund-policy
Disallow /resubscribe
Disallow /securepay
Disallow /transaction-status
Disallow /unsubscribe
Disallow /404
Disallow /500
Disallow /fonts/
Disallow /partial/

builtbottough

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

bytedancespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

alibabacloud

Rule Path
Disallow /

bytespyder

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.blueclean.in/sitemap.xml

Comments

  • Powered by Boost360