freedirectorysite.com
robots.txt

Robots Exclusion Standard data for freedirectorysite.com

Resource Scan

Scan Details

Site Domain freedirectorysite.com
Base Domain freedirectorysite.com
Scan Status Ok
Last Scan7/9/2025, 3:44:57 PM
Next Scan 7/16/2025, 3:44:57 PM

Last Scan

Scanned7/9/2025, 3:44:57 PM
URL https://freedirectorysite.com/robots.txt
Redirect https://www.freedirectorysite.com/robots.txt
Redirect Domain www.freedirectorysite.com
Redirect Base freedirectorysite.com
Domain IPs 104.21.49.81, 172.67.160.108, 2606:4700:3037::6815:3151, 2606:4700:3037::ac43:a06c
Redirect IPs 104.21.49.81, 172.67.160.108, 2606:4700:3037::6815:3151, 2606:4700:3037::ac43:a06c
Response IP 172.67.160.108
Found Yes
Hash 9999ed01d207b893dde03a0fd4c5af7d6ae3d4b6088a64ff8fd3d1a7da16b978
SimHash dc1cd9e0ead3

Groups

*

Rule Path
Disallow /pricing/
Disallow /pricing.php
Disallow /bot_site/

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /