botviewer.com
robots.txt

Robots Exclusion Standard data for botviewer.com

Resource Scan

Scan Details

Site Domain botviewer.com
Base Domain botviewer.com
Scan Status Ok
Last Scan2025-05-31T08:25:41+00:00
Next Scan 2025-06-30T08:25:41+00:00

Last Scan

Scanned2025-05-31T08:25:41+00:00
URL https://botviewer.com/robots.txt
Domain IPs 104.21.92.168, 172.67.196.143, 2606:4700:3036::6815:5ca8, 2606:4700:3037::ac43:c48f
Response IP 172.67.196.143
Found Yes
Hash 9835e102edfc75eb15e4d1a2bf429dd9a1c02cf81b5520e9a5fc48662f20a5f3
SimHash 794d5c45e593

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /panel/
Disallow /free-tools/

Other Records

Field Value
sitemap https://botviewer.com/sitemap.xml