wfdownloader.xyz
robots.txt

Robots Exclusion Standard data for wfdownloader.xyz

Resource Scan

Scan Details

Site Domain wfdownloader.xyz
Base Domain wfdownloader.xyz
Scan Status Ok
Last Scan2024-09-27T03:03:12+00:00
Next Scan 2024-10-04T03:03:12+00:00

Last Scan

Scanned2024-09-27T03:03:12+00:00
URL https://wfdownloader.xyz/robots.txt
Redirect https://www.wfdownloader.xyz/robots.txt
Redirect Domain www.wfdownloader.xyz
Redirect Base wfdownloader.xyz
Domain IPs 31.22.4.67
Redirect IPs 31.22.4.67
Response IP 31.22.4.67
Found Yes
Hash 70911f5c95af752f992cfc9100fd99903408f8dbc27e9160f5cd1143910f2d23
SimHash a988998167c2

Groups

*

Rule Path
Disallow /files/download/
Disallow /main/external
Disallow /download?no_ads=1

ltx71

Rule Path
Disallow /files/

semrushbot

Rule Path
Disallow /main/share/

Comments

  • robots.txt file for wfdownloader.xyz site