sitenet.tech
robots.txt

Robots Exclusion Standard data for sitenet.tech

Resource Scan

Scan Details

Site Domain sitenet.tech
Base Domain sitenet.tech
Scan Status Ok
Last Scan2025-08-16T16:27:56+00:00
Next Scan 2025-09-15T16:27:56+00:00

Last Scan

Scanned2025-08-16T16:27:56+00:00
URL https://sitenet.tech/robots.txt
Redirect https://d13d84ctgmh8da.cloudfront.net/daa93890-4c71-43b1-886b-1804ca155c2a/robots.txt
Redirect Domain d13d84ctgmh8da.cloudfront.net
Redirect Base d13d84ctgmh8da.cloudfront.net
Domain IPs 18.168.126.205, 3.11.150.116
Redirect IPs 2600:9000:2721:1800:10:2b8a:a780:21, 2600:9000:2721:5800:10:2b8a:a780:21, 2600:9000:2721:600:10:2b8a:a780:21, 2600:9000:2721:9600:10:2b8a:a780:21, 2600:9000:2721:a600:10:2b8a:a780:21, 2600:9000:2721:b600:10:2b8a:a780:21, 2600:9000:2721:d400:10:2b8a:a780:21, 2600:9000:2721:e00:10:2b8a:a780:21, 3.165.91.161, 3.165.91.188, 3.165.91.46, 3.165.91.9
Response IP 3.165.91.161
Found Yes
Hash a5034267e59ae288d3e022aa847c8924af1656a483ecac83fd340e2ff55ce1bd
SimHash 6800dc00e392

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10