On-Premises Generative AI

December, 2023
IDA document: 3000898
FFRDC: Systems and Analyses Center
Type: Documents , Research Summary/Research Insights
Division: Information Technology and Systems Division
Authors:
Authors
Arun S. Maiya See more authors
Download Publication
document cover image
Use of external services like OpenAI’s ChatGPT can pose a significant risk to the security of sensitive and personal data. A researcher at the Institute for Defense Analyses (IDA) developed a simple new software package called OnPrem.LLM. The package easily extracts, labels, and generates text using large language models without risk of data loss. This summary explores OnPrem.LLM’s features and provides an example of its use.