Topics
2 entries
Topic: Routing
The Privacy-Routing Problem
The choice is not cloud or local. Each request has its own sensitivity, and each needs its own route.
Beyond Cost-Quality: Privacy-Aware Routing for Local-to-Cloud LLM Escalation
A five-class scheme for labelling how sensitive a request is, and routing it only to the set of models allowed to see it.