endlessvideo.com
robots.txt
Robots Exclusion Standard data for endlessvideo.com
Resource Scan
Scan Details
Site Domain | endlessvideo.com |
Base Domain | endlessvideo.com |
Scan Status | Ok |
Last Scan | 4/7/2025, 4:42:46 PM |
Next Scan | 5/7/2025, 4:42:46 PM |
Last Scan
Scanned | 4/7/2025, 4:42:46 PM |
URL | https://endlessvideo.com/robots.txt |
Redirect | https://video.link/robots.txt |
Redirect Domain | video.link |
Redirect Base | video.link |
Domain IPs | 104.21.32.49, 172.67.183.82, 2606:4700:3031::6815:2031, 2606:4700:3031::ac43:b752 |
Redirect IPs | 104.26.14.56, 104.26.15.56, 172.67.73.2, 2606:4700:20::681a:e38, 2606:4700:20::681a:f38, 2606:4700:20::ac43:4902 |
Response IP | 172.67.73.2 |
Found | Yes |
Hash | bb99bc913b51b433f40c050b5253d521a7a8ea55817faf0117c0c2a404151bfc |
SimHash | 6431274c4393 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /application/ |
Disallow | /v1/ |
Disallow | /v2/ |
Disallow | /api* |
Disallow | /landing* |
Disallow | /submit* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://video.link/sitemap.xml |