filebistro.com
robots.txt
Robots Exclusion Standard data for filebistro.com
Resource Scan
Scan Details
| Site Domain | filebistro.com |
| Base Domain | filebistro.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-12-06T21:25:58+00:00 |
| Next Scan | 2025-12-13T21:25:58+00:00 |
Last Successful Scan
| Scanned | 2025-11-04T22:55:35+00:00 |
| URL | https://filebistro.com/robots.txt |
| Domain IPs | 104.21.8.210, 172.67.130.174, 2606:4700:3034::6815:8d2, 2606:4700:3036::ac43:82ae |
| Response IP | 172.67.130.174 |
| Found | Yes |
| Hash | 26b57b50a7fb28670ffeb1d04144ce9d7c660933f5c88bc2d2f25481a2ca9461 |
| SimHash | 687486034730 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp- |
| Disallow | /tag/ |
| Disallow | */trackback |
| Disallow | */page |
| Disallow | /author/* |
| Disallow | /template.html |
| Disallow | /readme.html |
| Disallow | *?replytocom |
| Disallow | /xmlrpc.php |
| Disallow | /*? |
| Disallow | /?s= |
| Allow | */uploads |
| Allow | *.js |
| Allow | *.css |
| Allow | *.png |
| Allow | *.gif |
| Allow | *.jpg |
Other Records
| Field | Value |
|---|---|
| sitemap | https://filebistro.com/sitemap.xml |
Warnings
- `host` is not a known field.