VI

VectorInstitute/vector-inference

Efficient LLM inference on Slurm clusters.

95 13 +0/wk
GitHub
audio-transcription inference llm llm-infernece llm-infrastructure multimodal reward-model sglang speech-to-text text-embedding vllm vlm
Trend 0

Star & Fork Trend (17 data points)

Stars
Forks

Multi-Source Signals

Growth Velocity

VectorInstitute/vector-inference has +0 stars this period . Velocity data will be available after more historical data is collected.

Deep analysis is being generated for this repository.

Signal-backed technical analysis will be available soon.

Metric vector-inference prompt-caching packages ellama
Stars 95 959494
Forks 13 47914
Weekly Growth +0 +0+0+0
Language Python TypeScriptTypeScriptRust
Sources 1 111
License Apache-2.0 MITMITApache-2.0

Capability Radar vs prompt-caching

vector-inference
prompt-caching
Maintenance Activity 100

Last code push 0 days ago.

Community Engagement 68

Fork-to-star ratio: 13.7%. Active community forking and contributing.

Issue Burden 70

Issue data not yet available.

Growth Momentum 30

No measurable growth in the current period (first-day cold start expected).

License Clarity 95

Licensed under Apache-2.0. Permissive — safe for commercial use.

Risk scores are computed from real-time repository data. Higher scores indicate healthier metrics.