If you don't run your own LLM proxy, how do you know whats going on?
Developers and infrastructure engineers need to understand deployment trade-offs between convenience and observability/security when using LLM APIs.
AI Summary
Opinion piece questioning the risks of relying on third-party LLM proxies without running your own infrastructure for visibility and control.
