askfred.net
robots.txt

Robots Exclusion Standard data for askfred.net

Resource Scan

Scan Details

Site Domain askfred.net
Base Domain askfred.net
Scan Status Ok
Last Scan2024-10-26T03:52:19+00:00
Next Scan 2024-11-25T03:52:19+00:00

Last Scan

Scanned2024-10-26T03:52:19+00:00
URL https://askfred.net/robots.txt
Redirect https://www.askfred.net/robots.txt
Redirect Domain www.askfred.net
Redirect Base askfred.net
Domain IPs 13.33.88.10, 13.33.88.19, 13.33.88.23, 13.33.88.85
Redirect IPs 18.205.36.100, 52.204.242.176, 54.157.58.70, 54.162.128.250
Response IP 54.157.58.70
Found Yes
Hash 46fa071701b37be9bd6f7e26605a26caf49b46fbdc024c1b1ede567e29855551
SimHash 85011946ef53

Groups

*
adsbot-google

Rule Path
Disallow /*.csv$
Disallow /*.json$
Disallow /*conversation$
Disallow /*webhooks$