codesforever.com
robots.txt

Robots Exclusion Standard data for codesforever.com

Resource Scan

Scan Details

Site Domain codesforever.com
Base Domain codesforever.com
Scan Status Ok
Last Scan2025-10-12T16:16:07+00:00
Next Scan 2025-11-11T16:16:07+00:00

Last Scan

Scanned2025-10-12T16:16:07+00:00
URL https://codesforever.com/robots.txt
Redirect https://www.codesforever.com/robots.txt
Redirect Domain www.codesforever.com
Redirect Base codesforever.com
Domain IPs 104.26.10.79, 104.26.11.79, 172.67.75.116, 2606:4700:20::681a:a4f, 2606:4700:20::681a:b4f, 2606:4700:20::ac43:4b74
Redirect IPs 104.26.10.79, 104.26.11.79, 172.67.75.116, 2606:4700:20::681a:a4f, 2606:4700:20::681a:b4f, 2606:4700:20::ac43:4b74
Response IP 104.26.10.79
Found Yes
Hash 1dbefe575b9ca6355a644beaa963fd7778cf3a87efaa5b5df05b2a72e4a7545c
SimHash e2eedb0aec73

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /refer/
Disallow /feed/
Disallow /tag/
Disallow /archives/
Disallow /trackback/
Disallow /testimonial/
Disallow /author/
Disallow /?s=
Disallow /search/
Disallow /cart/
Disallow /checkout/
Disallow /admin
Disallow /*add-to-cart%3D*
Disallow /my-account/
Disallow /es/
Disallow /ar/
Disallow /it/
Disallow /ru/
Disallow /nl/
Disallow /fr/
Disallow /de/
Disallow /zh-CN/
Disallow /pt/
Disallow /ja/
Disallow /wp-json/
Disallow /cdn-cgi/
Disallow /*?woodmart_reviews_sorting_select=*
Disallow /*%26woodmart_reviews_sorting_select%3D*
Disallow /*?add_to_wishlist=*
Disallow /*%26add_to_wishlist%3D*
Disallow /*?shop_view=*
Disallow /*%26shop_view%3D*
Disallow /*?per_row=*
Disallow /*%26per_row%3D*
Disallow /*?wcprbl_location=*
Disallow /*%26wcprbl_location%3D*
Disallow /*?amp=*
Disallow /*%26amp%3D*
Disallow /wp-content/uploads/*.svg$
Disallow /wp-content/uploads/*.pdf$
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.codesforever.com/sitemap_index.xml

Comments

  • Block ALL international language directories
  • Block technical endpoints
  • Block review sorting parameters
  • Block wishlist parameters
  • Block view parameters
  • Block location parameters
  • Block AMP parameters
  • Block media file crawling as pages
  • Allow necessary AJAX