gerdentusa.com
robots.txt

Robots Exclusion Standard data for gerdentusa.com

Resource Scan

Scan Details

Site Domain gerdentusa.com
Base Domain gerdentusa.com
Scan Status Ok
Last Scan2025-12-10T11:38:13+00:00
Next Scan 2026-01-09T11:38:13+00:00

Last Scan

Scanned2025-12-10T11:38:13+00:00
URL https://gerdentusa.com/robots.txt
Redirect https://www.gerdentusa.com/robots.txt
Redirect Domain www.gerdentusa.com
Redirect Base gerdentusa.com
Domain IPs 104.26.2.164, 104.26.3.164, 172.67.68.96, 2606:4700:20::681a:2a4, 2606:4700:20::681a:3a4, 2606:4700:20::ac43:4460
Redirect IPs 104.26.2.164, 104.26.3.164, 172.67.68.96, 2606:4700:20::681a:2a4, 2606:4700:20::681a:3a4, 2606:4700:20::ac43:4460
Response IP 172.67.68.96
Found Yes
Hash 9adea8c8312745605fae761aaa7bf1a12a69289ae56aaff7d735b6f81edbc455
SimHash efb5ddd2b892

Groups

*

Rule Path
Disallow
Disallow /api*
Disallow /*?page=*
Disallow /?s=*
Disallow /search-results/
Disallow /search-results?s=*
Disallow /index.php/
Disallow /index.php/search-results?s=*
Disallow *?s=s
Disallow *?s=home
Disallow *?s=faqs
Disallow *?s=videos
Disallow *?s=sitemap.xml
Disallow *?s=sales%2Forder%2Fhistory
Disallow *?s=blog%2Fcategory%2Fgeneral
Disallow /archives/
Disallow /reviews/
Disallow /comment/
Disallow /cart
Disallow /search/
Disallow /register
Disallow /checkout/
Disallow /login
Disallow /search-results?page=*
Disallow dev.gerdentusa.com/*
Disallow dev-gerdentusa-vatkg.ondigitalocean.app/*

Other Records

Field Value
sitemap https://www.gerdentusa.com/sitemap.xml

Comments

  • Disallow crawling relative pages