bigduck.com
robots.txt
Robots Exclusion Standard data for bigduck.com
Resource Scan
Scan Details
Site Domain | bigduck.com |
Base Domain | bigduck.com |
Scan Status | Ok |
Last Scan | 2025-09-24T18:04:50+00:00 |
Next Scan | 2025-10-24T18:04:50+00:00 |
Last Scan
Scanned | 2025-09-24T18:04:50+00:00 |
URL | https://bigduck.com/robots.txt |
Domain IPs | 104.21.77.65, 172.67.205.34, 2606:4700:3032::6815:4d41, 2606:4700:3032::ac43:cd22 |
Response IP | 172.67.205.34 |
Found | Yes |
Hash | ae8b006e59c8c4af4af821b77ee69161da35cca8a1224d0b1607b9a45df3df54 |
SimHash | 4b68c880a49a |
Other Records
Field | Value |
---|---|
sitemap | https://bigduck.com/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments