spanglefish.com
robots.txt
Robots Exclusion Standard data for spanglefish.com
Resource Scan
Scan Details
| Site Domain | spanglefish.com |
| Base Domain | spanglefish.com |
| Scan Status | Ok |
| Last Scan | 2024-10-27T12:26:39+00:00 |
| Next Scan | 2024-11-03T12:26:39+00:00 |
Last Scan
| Scanned | 2024-10-27T12:26:39+00:00 |
| URL | https://spanglefish.com/robots.txt |
| Domain IPs | 54.73.18.6 |
| Response IP | 54.73.18.6 |
| Found | Yes |
| Hash | 1d153fb994ead94a82c8921f95164fabc760f8f38202ad40f649cb99c9a997e6 |
| SimHash | 4b16d81252a5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.pdf$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.ppt$ |
| Disallow | /*.pptx$ |
| Disallow | /*.rtf$ |
| Disallow | /*.mp3$ |
| Disallow | /*/documents/ |
Comments