cgikeys.com
robots.txt

Robots Exclusion Standard data for cgikeys.com

Resource Scan

Scan Details

Site Domain cgikeys.com
Base Domain cgikeys.com
Scan Status Ok
Last Scan2025-10-02T18:39:08+00:00
Next Scan 2025-11-01T18:39:08+00:00

Last Scan

Scanned2025-10-02T18:39:08+00:00
URL https://cgikeys.com/robots.txt
Domain IPs 104.26.14.143, 104.26.15.143, 172.67.75.106, 2606:4700:20::681a:e8f, 2606:4700:20::681a:f8f, 2606:4700:20::ac43:4b6a
Response IP 104.26.15.143
Found Yes
Hash 3e8f06f9fd59a3c4d6e91fcdf3b52fa7eb6ca76ca6bd904f4ce45cbe121cfb62
SimHash 480849454733

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
sitemap http://www.cgikeys.com/post-sitemap.xml
sitemap http://www.cgikeys.com/page-sitemap.xml
sitemap https://www.cgikeys.com/product-sitemap.xml
sitemap https://www.cgikeys.com/category-sitemap.xml
sitemap https://www.cgikeys.com/post_tag-sitemap.xml
sitemap https://www.cgikeys.com/product_brand-sitemap.xml
sitemap https://www.cgikeys.com/product_cat-sitemap.xml
sitemap https://www.cgikeys.com/product_shipping_class-sitemap.xml
sitemap https://www.cgikeys.com/pa_brand-sitemap.xml
sitemap https://www.cgikeys.com/sitemap_index.xml