rajkamalprakashan.com
robots.txt

Robots Exclusion Standard data for rajkamalprakashan.com

Resource Scan

Scan Details

Site Domain rajkamalprakashan.com
Base Domain rajkamalprakashan.com
Scan Status Ok
Last Scan2025-10-21T10:21:51+00:00
Next Scan 2025-11-20T10:21:51+00:00

Last Scan

Scanned2025-10-21T10:21:51+00:00
URL https://rajkamalprakashan.com/robots.txt
Domain IPs 104.21.39.34, 172.67.142.230, 2606:4700:3032::6815:2722, 2606:4700:3036::ac43:8ee6
Response IP 104.21.39.34
Found Yes
Hash 2ad5da66d8e82eadde7850986f829f2f5b9a05c8d3716e1168db23f68f2ca8d0
SimHash 7837e85ae2d3

Groups

*

Rule Path
Disallow /admin/
Disallow /checkout/
Disallow /cart/
Disallow /customer/
Disallow /wishlist/
Disallow /order/
Disallow /payment/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /checkout/thankyou/
Disallow /cgi-bin/
Disallow /root/

dotbot
dotbot

Rule Path
Disallow /
Disallow /admin/
Disallow /checkout/
Disallow /cart/
Disallow /customer/
Disallow /wishlist/
Disallow /order/
Disallow /payment/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /checkout/thankyou/
Disallow /cgi-bin/
Disallow /root/

gptbot
gptbot

Rule Path
Disallow /
Disallow /admin/
Disallow /checkout/
Disallow /cart/
Disallow /customer/
Disallow /wishlist/
Disallow /order/
Disallow /payment/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /checkout/thankyou/
Disallow /cgi-bin/
Disallow /root/

Comments

  • Allow all search engines to crawl the site
  • Block specific bots like DotBot (optional)
  • Block specific bots like GPTBot (optional)