A Privacy Preserving LLM Chatbot with Inbuilt Authentication and Elastic Hardware Support: a Team Invention

Case ID:
UA24-190
Invention:

This technology is a novel chatbot architecture, Chatür, which is a full stack chatbot provided as a service with the ability to be fine-tuned/trained only on user presented data. Chatür prioritizes privacy by keeping all data within the user's hardware, ensuring user information remains secure. It boasts elastic support with cutting-edge hardware, meaning it can adapt and scale efficiently to varying workloads. Additionally, it features built-in authentication and authorization mechanisms which enhances user security. Integration with existing software pipelines is seamless, making adoption easier for businesses. Unlike some counterparts, Chatür does not produce nonsensical responses (hallucinations), ensuring coherent interactions. Moreover, it has the potential to operate over HIPAA protected data, meeting stringent healthcare data privacy requirements. This chatbot architecture is unique in that it can be fine-tuned or trained solely on user-provided data, preserving privacy while allowing customization to mimic emotional awareness and various human personality traits.

Background: 
The technology aims to address several key issues prevalent in current chatbot architectures. One major concern is privacy. Existing solutions, like OpenAI's ChatGPT, often involve sending user data to external servers for processing, raising privacy and security risks. Additionally, current models lack fine-tuning capabilities on user-provided data, limiting personalization while posing potential privacy threats. Many chatbots struggle to handle fluctuating workloads effectively, leading to performance issues during peak times. Moreover, some models produce nonsensical responses, diminishing user experience and trust. Chatür’s approach contrasts with existing chatbot models by allowing customization based on user-provided data while preserving privacy. Additionally, with built-in elastic support and state-of-the-art hardware, the architecture ensures efficient scaling to meet varying workloads, improving overall performance and reliability. By addressing these key issues, Chatür represents a significant advancement in chatbot development, offering enhanced privacy, personalization, and scalability compared to current solutions.

Applications: 

  • Chatbots for various industries, such as:
    • Healthcare
    • E-commerce
    • Education


Advantages: 

  • Elimination of hallucinations
  • Enhanced privacy 
  • Reduced training cost
  • Scalable
Patent Information:
Contact For More Information:
Lewis Humphreys
Licensing Manager, Eller College of Mngmt & OTT
The University of Arizona
lewish@tla.arizona.edu
Lead Inventor(s):
Mithun Paul
Nirav Merchant
Keywords: