vider.to
robots.txt

Robots Exclusion Standard data for vider.to

Resource Scan

Scan Details

Site Domain vider.to
Base Domain vider.to
Scan Status Ok
Last Scan2025-03-11T15:02:09+00:00
Next Scan 2025-03-18T15:02:09+00:00

Last Scan

Scanned2025-03-11T15:02:09+00:00
URL https://vider.to/robots.txt
Domain IPs 104.21.9.145, 172.67.160.154, 2606:4700:3032::6815:991, 2606:4700:3032::ac43:a09a
Response IP 104.21.9.145
Found Yes
Hash a632a99af7a6a95673182a32dda073f499f75ccbca5cdc47f7588f3ae33e12b8
SimHash 4d3cde54cc33

Groups

*

Rule Path
Disallow /api/

facebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebot/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://vider.to/sitemap.xml