allaboutbirds.org
robots.txt

Robots Exclusion Standard data for allaboutbirds.org

Resource Scan

Scan Details

Site Domain allaboutbirds.org
Base Domain allaboutbirds.org
Scan Status Ok
Last Scan2024-05-31T10:07:05+00:00
Next Scan 2024-06-30T10:07:05+00:00

Last Scan

Scanned2024-05-31T10:07:05+00:00
URL https://allaboutbirds.org/robots.txt
Redirect https://www.allaboutbirds.org/robots.txt
Redirect Domain www.allaboutbirds.org
Redirect Base allaboutbirds.org
Domain IPs 104.26.0.144, 104.26.1.144, 172.67.69.67, 2606:4700:20::681a:190, 2606:4700:20::681a:90, 2606:4700:20::ac43:4543
Redirect IPs 104.26.0.144, 104.26.1.144, 172.67.69.67, 2606:4700:20::681a:190, 2606:4700:20::681a:90, 2606:4700:20::ac43:4543
Response IP 104.26.0.144
Found Yes
Hash 506e29d5573756a7715a65a5be464b3b673eb800012bcf3d9fd3b36b8723736c
SimHash c854ce82f202

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /stagingguide/
Disallow /guide/*/media-browser-overview/
Disallow /guide/noindex/
Disallow /guide/noindex/photo/*.jpg$
Disallow /guide/noindex/photo/*.png$

ahrefsbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /guide/noindex/photo/*.jpg$
Disallow /guide/noindex/photo/*.png$
Disallow /guide/noindex/*.jpg$
Disallow /guide/noindex/*.png$