saigon.com
robots.txt

Robots Exclusion Standard data for saigon.com

Resource Scan

Scan Details

Site Domain saigon.com
Base Domain saigon.com
Scan Status Ok
Last Scan2025-10-05T15:12:49+00:00
Next Scan 2025-10-12T15:12:49+00:00

Last Scan

Scanned2025-10-05T15:12:49+00:00
URL https://saigon.com/robots.txt
Domain IPs 104.21.64.146, 172.67.151.149, 2606:4700:3033::6815:4092, 2606:4700:3034::ac43:9795
Response IP 104.21.64.146
Found Yes
Hash 3c113884923ffa8b57ac26049976f82759bf6ec32e2c69b5b8c6ee251bc44079
SimHash c820482def24

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /www/cgi-bin

mediapartners-google*

Rule Path
Disallow

Comments

  • keep them out of the CGI-BIN areas