上游供应商单人单key的方式接入higress的最佳实践应该是怎么样的 #3848
Unanswered
z739608053-collab
asked this question in
Q&A
Replies: 1 comment
-
|
可以对 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
公司对接了某家模型供应商(提供多种模型服务claude、gpt、glm等,模型供应商会给我们公司每个员工单独下发apikey,每个key比如2000块额度, 员工可以根据需要可自由切换模型(额度扣完为止)
原先的想法是 在模型服务提供者处不配置凭证, 将员工的apikey在higress上注册为消费者进行路由配置,在消费者请求时通过Authorrization进行透传, 该想法进行验证 在重启higress时 遇到了ai proxy failed to load的问题, 看起来模型服务商是有必须设置凭证的约束, 请问这种情况下该如何接入(应该不能是一个key注册一个服务供应商 再单独配一个路由允许对应的消费者访问, 公司员工有点多)
Beta Was this translation helpful? Give feedback.
All reactions