gfycat.com
robots.txt
Robots Exclusion Standard data for gfycat.com
Resource Scan
Scan Details
Site Domain | gfycat.com |
Base Domain | gfycat.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-09T17:21:35+00:00 |
Next Scan | 2025-01-07T17:21:35+00:00 |
Last Successful Scan
Scanned | 2023-08-30T21:22:32+00:00 |
URL | https://gfycat.com/robots.txt |
Domain IPs | 13.33.91.233, 2600:9000:223b:1000:d:a332:70d3:ea1, 2600:9000:223b:1a00:d:a332:70d3:ea1, 2600:9000:223b:2400:d:a332:70d3:ea1, 2600:9000:223b:400:d:a332:70d3:ea1, 2600:9000:223b:8e00:d:a332:70d3:ea1, 2600:9000:223b:ba00:d:a332:70d3:ea1, 2600:9000:223b:f600:d:a332:70d3:ea1, 2600:9000:223b:fa00:d:a332:70d3:ea1 |
Response IP | 52.84.187.224 |
Found | Yes |
Hash | 1624fd58b866cd12919121322e5f33d31f3a561f16e951be223eb5cdb1933777 |
SimHash | cc4492324235 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /login?redirectUri=* |
Disallow | /*/login?redirectUri=* |
Disallow | /signup?redirectUri=* |
Disallow | /*/signup?redirectUri=* |
Disallow | /logout |
Disallow | /cajax |
Disallow | /.* |
Disallow | /javascript/* |
Disallow | /%40*/manage/* |