birddealer.com
robots.txt
Robots Exclusion Standard data for birddealer.com
Resource Scan
Scan Details
| Site Domain | birddealer.com |
| Base Domain | birddealer.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T21:28:40+00:00 |
| Next Scan | 2024-11-05T21:28:40+00:00 |
Last Scan
| Scanned | 2024-10-29T21:28:40+00:00 |
| URL | https://birddealer.com/robots.txt |
| Redirect | https://www.birddealer.com/robots.txt |
| Redirect Domain | www.birddealer.com |
| Redirect Base | birddealer.com |
| Domain IPs | 139.162.24.66 |
| Redirect IPs | 139.162.24.66 |
| Response IP | 139.162.24.66 |
| Found | Yes |
| Hash | 9b1fcbb985d59dfc19efff742b22f4b61ba5d914ee58fca3f0e97be8effc457e |
| SimHash | d4017975454f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /mail/ |
| Disallow | /captcha/ |
| Disallow | /css/ |
| Disallow | /js/ |
| Disallow | /australianbirdsclubs_files/ |
| Disallow | /australianbirdsdealers_files/ |
| Disallow | /australianbirdslicences_files/ |
| Disallow | /australianbirdsproducts_files/ |
| Disallow | /australianendangeredbirds_files/ |
| Disallow | /australianfinches_files/ |
| Disallow | /australianpets_files/ |
| Disallow | /australianpetsforums_files/ |
| Disallow | /birdsopticalillusions_files/ |
| Disallow | /index_files/ |