andreiweber.com
robots.txt

Robots Exclusion Standard data for andreiweber.com

Resource Scan

Scan Details

Site Domain andreiweber.com
Base Domain andreiweber.com
Scan Status Ok
Last Scan2025-10-22T17:56:35+00:00
Next Scan 2025-11-05T17:56:35+00:00

Last Scan

Scanned2025-10-22T17:56:35+00:00
URL https://andreiweber.com/robots.txt
Domain IPs 104.21.17.241, 172.67.178.223, 2606:4700:3034::ac43:b2df, 2606:4700:3037::6815:11f1
Response IP 104.21.17.241
Found Yes
Hash aca3123e2be4d2c5d2a27b149a920ff28695e8a0ace2bb30d48d168cf1bd0e5c
SimHash 69148bc65790

Groups

*

Rule Path
Disallow /admin/

*

Rule Path
Allow

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Allow