sunpro.build
robots.txt

Robots Exclusion Standard data for sunpro.build

Resource Scan

Scan Details

Site Domain sunpro.build
Base Domain sunpro.build
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-23T17:12:55+00:00
Next Scan 2025-09-21T17:12:55+00:00

Last Successful Scan

Scanned2025-05-02T04:07:05+00:00
URL https://sunpro.build/robots.txt
Redirect https://sunpro.build/?robots=1
Domain IPs 104.21.65.161, 172.67.147.38, 2606:4700:3032::ac43:9326, 2606:4700:3033::6815:41a1
Response IP 104.21.65.161
Found Yes
Hash c2c052cccb62afee6a88ab7e6b82296b9b742ccd1f7fe77ebf1e0d62c961aaf3
SimHash 42c8d842a231

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /wp-json/
Disallow /readme.html
Disallow /refer/
Allow /wp-admin/admin-ajax.php

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

voltron

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://site.com/sitemap.xml
sitemap https://sunpro.build/sitemap.xml