widget.fm
robots.txt
Robots Exclusion Standard data for widget.fm
Resource Scan
Scan Details
Site Domain | widget.fm |
Base Domain | widget.fm |
Scan Status | Ok |
Last Scan | 2024-09-01T23:14:28+00:00 |
Next Scan | 2024-10-01T23:14:28+00:00 |
Last Scan
Scanned | 2024-09-01T23:14:28+00:00 |
URL | https://widget.fm/robots.txt |
Domain IPs | 104.26.8.70, 104.26.9.70, 172.67.71.144, 2606:4700:20::681a:846, 2606:4700:20::681a:946, 2606:4700:20::ac43:4790 |
Response IP | 104.26.9.70 |
Found | Yes |
Hash | a755539b2691c284127e34c94dba4bdf859f3692393daba3d2ab3b7fe5d4713e |
SimHash | 1711d87b8e71 |
Groups
*
Rule | Path |
---|---|
Disallow | /tilda/form* |
Disallow | /tilda/rec* |
Disallow | /tilda/click* |
Disallow | /tilda/scroll* |
Disallow | /tilda/popup* |
Disallow | /tilda/cart* |
Disallow | /tilda/product* |
Disallow | /tilda/event* |
Disallow | /*_escaped_fragment_* |
Disallow |
Other Records
Field | Value |
---|---|
sitemap | http://widget.fm/sitemap.xml |
Warnings
- `host` is not a known field.