wilio.co.tz
robots.txt

Robots Exclusion Standard data for wilio.co.tz

Resource Scan

Scan Details

Site Domain wilio.co.tz
Base Domain wilio.co.tz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-06T11:23:04+00:00
Next Scan 2025-06-04T11:23:04+00:00

Last Successful Scan

Scanned2023-05-12T03:24:37+00:00
URL https://wilio.co.tz/robots.txt
Redirect https://www.wilio.co.tz/robots.txt
Redirect Domain www.wilio.co.tz
Redirect Base wilio.co.tz
Domain IPs 104.21.70.220, 172.67.139.245, 2606:4700:3030::ac43:8bf5, 2606:4700:3033::6815:46dc
Redirect IPs 104.21.70.220, 172.67.139.245, 2606:4700:3030::ac43:8bf5, 2606:4700:3033::6815:46dc
Response IP 104.21.70.220
Found Yes
Hash 0e6e67baeed9528c722ac40b2e342319a843769a0bf22ec88b67361beda850b4
SimHash ed00f343ae7b

Groups

*

Rule Path
Disallow /register
Disallow /registration
Disallow /login
Disallow /forgotten-password
Disallow /logout
Disallow /verify-email
Disallow /my-projects
Disallow /new-demand
Disallow /app/
Disallow /sp/
Disallow /blog
Disallow /category/
Disallow /webapp/
Allow /ads.txt
Allow /app-ads.txt

Other Records

Field Value
sitemap https://www.wilio.co.tz/sitemap.xml