pestoai.com
robots.txt

Robots Exclusion Standard data for pestoai.com

Resource Scan

Scan Details

Site Domain pestoai.com
Base Domain pestoai.com
Scan Status Ok
Last Scan2025-04-08T12:53:48+00:00
Next Scan 2025-04-22T12:53:48+00:00

Last Scan

Scanned2025-04-08T12:53:48+00:00
URL https://pestoai.com/robots.txt
Redirect https://www.pestoai.com/robots.txt
Redirect Domain www.pestoai.com
Redirect Base pestoai.com
Domain IPs 108.157.254.118, 108.157.254.38, 108.157.254.61, 108.157.254.94, 2600:9000:2816:3000:12:957d:9b80:93a1, 2600:9000:2816:3c00:12:957d:9b80:93a1, 2600:9000:2816:5c00:12:957d:9b80:93a1, 2600:9000:2816:7200:12:957d:9b80:93a1, 2600:9000:2816:9800:12:957d:9b80:93a1, 2600:9000:2816:a800:12:957d:9b80:93a1, 2600:9000:2816:ae00:12:957d:9b80:93a1, 2600:9000:2816:cc00:12:957d:9b80:93a1
Redirect IPs 13.226.61.102, 13.226.61.106, 13.226.61.70, 13.226.61.88
Response IP 3.170.229.27
Found Yes
Hash a0f500c47b3e65f03923d384afe7e1057063f6e2e20b5651b69f336ce78fb042
SimHash f9013c60ad92

Groups

*

Rule Path
Disallow /images/
Disallow /assets/

Other Records

Field Value
sitemap http://www.pestoai.com/sitemap.xml