Back to agent index
Local GPT

Local GPT

Task automation agent by Local GPT

Empower your data interactions with Local GPT, the AI agent that prioritizes unparalleled privacy and efficiency by processing everything locally, ensuring your sensitive information stays secure while you harness advanced AI capabilities.

ProductivityBusinessesOpen source
github.com/PromtEngineer/localGPT

Local GPT is an advanced AI agent designed to provide users with a secure and efficient way to interact with their data locally. Developed with the goal of maintaining complete data privacy, Local GPT empowers users to process and generate text without compromising their sensitive information. This makes it particularly useful for businesses and individuals who prioritize confidentiality and efficiency in their data handling.

Features

Local GPT comes equipped with a variety of features that ensure both privacy and functionality. These features allow users to customize their AI experience based on their specific needs and requirements. Below is a detailed overview of the key features:

Feature Description
Uncompromising Privacy All processing occurs locally on your device, ensuring complete data security, with no data leaving your computer.
Versatile Model Support Supports a variety of open-source models, including HF, GPTQ, GGML, and GGUF formats for diverse AI tasks.
Diverse Embeddings Offers a range of open-source embedding options, allowing customization for different applications.
Efficient Model Usage Enables downloading LLMs once for reuse across multiple sessions, optimizing bandwidth and time.
Persistent Chat History Maintains context by remembering previous conversations within a session, enhancing interaction coherence.
User-Friendly Interface Includes two graphical user interfaces: an API-based interface and a standalone interface built with Streamlit.
Multi-Platform Support Compatible with GPU (CUDA), CPU, or MPS, allowing efficient operation on various hardware setups.

Use cases

Local GPT can be applied in various scenarios where secure and efficient AI processing is essential. Some examples include:

  • Analyzing Confidential Business Documents: Utilize Local GPT to process sensitive business information without risking data exposure.
  • Researching Sensitive Personal Information: Conduct in-depth research on private matters while ensuring data remains on your device.
  • Exploring Private Datasets Without Cloud Exposure: Analyze datasets locally, maintaining privacy and control over the data.
  • Developing Secure, Offline AI Applications: Create applications that require AI functionalities without relying on an internet connection.

How to get started

To begin using Local GPT, follow these steps:

  1. Clone the Repository: From GitHub, clone the Local GPT repository.
  2. Install Dependencies: Install the required dependencies as outlined in the repository.
  3. Run Document Processing: Execute ingest.py to process your documents locally.
  4. Interact with Data: Launch run_localGPT.py to start engaging with your data.

Pricing Information

Below is an indication of pricing for various AI models and services. Please note that pricing can vary over time.

Azure OpenAI Service

  • GPT-4o Global: Input $5/1M tokens, Output $20/1M tokens
  • GPT-4o Mini Global: Input $0.15/1M tokens, Output $0.60/1M tokens

GPT for Work

  • GPT-3.5 Turbo: Input $1.50/1M tokens, Output $2.00/1M tokens
  • GPT-4 Turbo: Input $10.00/1M tokens, Output $30.00/1M tokens

ChatGPT Pricing

  • ChatGPT-4o: Input $2.50/1M tokens, Output $10.00/1M tokens
  • ChatGPT-4o Mini: Input $0.15/1M tokens, Output $0.60/1M tokens

Pricing for "Local GPT" is not available.