wilio.bg
robots.txt

Robots Exclusion Standard data for wilio.bg

Resource Scan

Scan Details

Site Domain wilio.bg
Base Domain wilio.bg
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/17/2025, 2:39:36 AM
Next Scan 7/16/2025, 2:39:36 AM

Last Successful Scan

Scanned12/18/2023, 2:13:44 AM
URL http://www.wilio.bg/robots.txt
Domain IPs 3.66.159.216, 3.72.154.173, 3.74.202.68
Response IP 3.66.159.216
Found Yes
Hash 751e603958b5a6e2d67ba369440dfe09f3efd81b5baeb1e45eb619eda88c798d
SimHash 6900bb43ae73

Groups

*

Rule Path
Disallow /register
Disallow /registration
Disallow /login
Disallow /forgotten-password
Disallow /logout
Disallow /verify-email
Disallow /my-projects
Disallow /new-demand
Disallow /app/
Disallow /sp/
Disallow /blog
Disallow /category/
Disallow /webapp/
Allow /ads.txt
Allow /app-ads.txt

Other Records

Field Value
sitemap https://www.wilio.bg/sitemap.xml