allbirdspecies.com
robots.txt
Robots Exclusion Standard data for allbirdspecies.com
Resource Scan
Scan Details
Site Domain | allbirdspecies.com |
Base Domain | allbirdspecies.com |
Scan Status | Ok |
Last Scan | 2024-11-14T09:11:02+00:00 |
Next Scan | 2024-11-21T09:11:02+00:00 |
Last Scan
Scanned | 2024-11-14T09:11:02+00:00 |
URL | https://allbirdspecies.com/robots.txt |
Domain IPs | 104.21.93.105, 172.67.208.213, 2606:4700:3031::6815:5d69, 2606:4700:3036::ac43:d0d5 |
Response IP | 104.21.93.105 |
Found | Yes |
Hash | 525df73d51514ff9ba5c615420d65a2c29710a6e77fc9467b9c87cd93922b368 |
SimHash | 884cc8c0a01b |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://allbirdspecies.com/sitemap.xml |
Comments