flashbak.com
robots.txt
Robots Exclusion Standard data for flashbak.com
Resource Scan
Scan Details
Site Domain | flashbak.com |
Base Domain | flashbak.com |
Scan Status | Ok |
Last Scan | 2024-11-01T22:03:23+00:00 |
Next Scan | 2024-11-08T22:03:23+00:00 |
Last Scan
Scanned | 2024-11-01T22:03:23+00:00 |
URL | https://flashbak.com/robots.txt |
Domain IPs | 89.16.176.199 |
Response IP | 89.16.176.199 |
Found | Yes |
Hash | 2f43c61bae156f21c1722a1720d0a84f921fb316184f28839970004e3d981d9f |
SimHash | e4148ed37296 |
Groups
*
Rule | Path |
---|---|
Disallow | *.html/feed* |
Disallow | *.html/trackback* |
Disallow | *?s=* |
Disallow | *?audioselect=* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Warnings
- 1 invalid line.