docspert.com
robots.txt

Robots Exclusion Standard data for docspert.com

Resource Scan

Scan Details

Site Domain docspert.com
Base Domain docspert.com
Scan Status Ok
Last Scan5/15/2025, 9:46:14 AM
Next Scan 6/14/2025, 9:46:14 AM

Last Scan

Scanned5/15/2025, 9:46:14 AM
URL https://docspert.com/robots.txt
Redirect https://www.docspert.com/robots.txt
Redirect Domain www.docspert.com
Redirect Base docspert.com
Domain IPs 104.21.8.250, 172.67.158.42, 2606:4700:3036::ac43:9e2a, 2606:4700:3037::6815:8fa
Redirect IPs 104.21.8.250, 172.67.158.42, 2606:4700:3036::ac43:9e2a, 2606:4700:3037::6815:8fa
Response IP 104.21.8.250
Found Yes
Hash bca263c28b497b3e58b6a97aaf0841d064f2456e545b489909bba1730ab5f748
SimHash 68094c44cf92

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.docspert.com/sitemap.xml
sitemap https://www.docspert.com/blog/sitemap_index.xml