threadflix.fr
robots.txt
Robots Exclusion Standard data for threadflix.fr
Resource Scan
Scan Details
Site Domain | threadflix.fr |
Base Domain | threadflix.fr |
Scan Status | Ok |
Last Scan | 2024-09-29T05:23:25+00:00 |
Next Scan | 2024-10-06T05:23:25+00:00 |
Last Scan
Scanned | 2024-09-29T05:23:25+00:00 |
URL | https://threadflix.fr/robots.txt |
Domain IPs | 104.21.93.5, 172.67.201.217, 2606:4700:3030::6815:5d05, 2606:4700:3034::ac43:c9d9 |
Response IP | 104.21.93.5 |
Found | Yes |
Hash | b8fd796537ca6ec5a0e2a8f5718b0a0841c7bf615069df297f4e3288daf3475e |
SimHash | 4104485247f3 |
Groups
*
Rule | Path |
---|---|
Disallow | /profil/%3Cbr |
Disallow | /profile/%3Cbr |
Disallow | /perfil/%3Cbr |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://threadflix.fr/sitemap.xml |