babylonvid.com
robots.txt
Robots Exclusion Standard data for babylonvid.com
Resource Scan
Scan Details
Site Domain | babylonvid.com |
Base Domain | babylonvid.com |
Scan Status | Ok |
Last Scan | 2024-11-14T22:34:20+00:00 |
Next Scan | 2024-11-21T22:34:20+00:00 |
Last Scan
Scanned | 2024-11-14T22:34:20+00:00 |
URL | https://babylonvid.com/robots.txt |
Domain IPs | 2.40.106.70 |
Response IP | 2.40.106.70 |
Found | Yes |
Hash | 81d3ccc2b79c6814fc9eed425611085e198ff4a8c3891f83f125451967b9e2a6 |
SimHash | 142fd2637594 |
Groups
*
Product | Comment |
---|---|
* | applicazione a tutti i crawler\bots |
Rule | Path | Comment |
---|---|---|
Allow | /video/* | permette la scansione di video |
Other Records
Field | Value |
---|---|
sitemap | https://or-videos.babyloncloud.com/video_0/sitemap_main_index.xml |
Comments