Log In Sign Up

censlighting.com
robots.txt

Robots Exclusion Standard data for censlighting.com

Resource Scan

Scan Details

Site Domain censlighting.com
Base Domain censlighting.com
Scan Status Ok
Last Scan2025-12-29T13:55:48+00:00
Next Scan 2026-01-12T13:55:48+00:00

Last Scan

Scanned2025-12-29T13:55:48+00:00
URL https://censlighting.com/robots.txt
Domain IPs 104.26.8.156, 104.26.9.156, 172.67.71.187, 2606:4700:20::681a:89c, 2606:4700:20::681a:99c, 2606:4700:20::ac43:47bb
Response IP 104.26.8.156
Found Yes
Hash 5054df8c627ebaba2b1a369c32e3f0fc87200f8cca774717d8a49edc40935921
SimHash 681549d44289

Groups

pinnerbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/uploads/
Disallow /wp-json/
Disallow /trackback/
Disallow /feed/

googlebot

Rule Path
Allow /
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-json/
Disallow /trackback/
Disallow /feed/
Back to top

Comments

  • Allow Pinnerbot to access product pages only
  • Disallow other search engine crawlers from accessing specific directories
  • Allow Googlebot to access product pages only
  • Disallow other search engine crawlers from accessing specific directories
Back to top