tv.sfr.fr
robots.txt
Robots Exclusion Standard data for tv.sfr.fr
Resource Scan
Scan Details
| Site Domain | tv.sfr.fr |
| Base Domain | sfr.fr |
| Scan Status | Ok |
| Last Scan | 2024-11-03T07:23:52+00:00 |
| Next Scan | 2024-12-03T07:23:52+00:00 |
Last Scan
| Scanned | 2024-11-03T07:23:52+00:00 |
| URL | https://tv.sfr.fr/robots.txt |
| Domain IPs | 109.0.66.36, 109.0.66.44, 109.0.66.52, 109.0.66.60, 2a02:8400::5456:20:1, 2a02:8400::5456:4020:1, 2a02:8400::5456:8020:1, 2a02:8400::5456:c020:1 |
| Response IP | 109.0.66.52 |
| Found | Yes |
| Hash | 19f5e108f7d11b94deb2c1932ef0fc19f2739f04c7ccea5850064be7553aeda4 |
| SimHash | a09b7802cfb5 |
Groups
ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper
aboundexbot
aboundex/0.2
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | /channel/1$ |
| Disallow | /channel* |
| Disallow | /assets/ |
| Disallow | /settings/ |