NetBrain integration with AI API Proxy

Hi Support Team,

As most of our customers is running in mission critical environment, sometime with air-gapped network, so using public AI LLM like OpenAI or ChatGPT etc. will be a challenge. I understand that NetBrain can also integrate with local deployed AI inferencing servers, however an enterprise grade inferencing server also costs very high.

One possible option is to use AI API proxy servers like LiteLLM Proxy or Apache APISIX or Kong AI Gateway etc., the dual home proxy server could be located in restricted DMZ zone which has limited internet connection to Open AI platforms, while NetBrain can point the AI proxy to the API server.

I am wondering if NetBrain has any similar deployment cases in your customer’s environment. It will be appreciated if you could provide some references or ideas for this type of deployment.

Best Regards,

Andong