tesfluid.com
robots.txt
Robots Exclusion Standard data for tesfluid.com
Resource Scan
Scan Details
Site Domain | tesfluid.com |
Base Domain | tesfluid.com |
Scan Status | Ok |
Last Scan | 2024-11-04T09:10:28+00:00 |
Next Scan | 2024-12-04T09:10:28+00:00 |
Last Scan
Scanned | 2024-11-04T09:10:28+00:00 |
URL | https://tesfluid.com/robots.txt |
Redirect | https://www.tesfluid.com/robots.txt |
Redirect Domain | www.tesfluid.com |
Redirect Base | tesfluid.com |
Domain IPs | 89.46.105.50, 93.33.234.106 |
Redirect IPs | 89.46.105.50 |
Response IP | 89.46.105.50 |
Found | Yes |
Hash | 0825b4fb62f8ab592795e2d2395d968f44f579673bb5c3876d330fa9bca997d9 |
SimHash | c47ccca2c2fb |
Groups
*
Rule | Path |
---|---|
Disallow | /*.jpg |
Disallow | /*.JPG |
Disallow | /*.png |
Disallow | |
Disallow | |
Disallow | /*.mp3 |
Disallow | /*.MOV |
Disallow | /*.mov |
Disallow | /*.AVI |
Disallow | /*.avi |
Disallow | /*.csv |
Disallow | /*.data |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |