Making Llama More Accessible

Introduction

• Mainframe has open-sourced and released an early beta of fullmoon, an experimental app for chatting with private and local large language models.
  • Link: fullmoon
• Focus is on enhancing accessibility and experience of chatting with Llama 3.2 models.
  • Link: Llama 3.2 Blog

Llama 3.2 Models

• Lightweight 1B and 3B models
• Allows local running of models:
  • Advantages:
    • Instantaneous prompts and responses due to local processing.
    • Enhanced privacy as data is not sent to the cloud.

fullmoon App

• Experimental iOS app to chat with Llama.
  • Optimized for Apple Silicon.
  • Available on iPhone, iPad, and Mac.
  • Local chat history storage.
  • Customizable app appearance.
• Available on TestFlight as an early beta.
  • TestFlight Access

Open Source & Development

• fullmoon iOS app is open-sourced on GitHub.
  • Built with SwiftUI.
• Powered by MLX Swift from Apple.
  • MLX: Array framework for ML research on Apple silicon.
  • GitHub Links: MLX Swift and MLX

Community and Collaboration

• Welcoming feedback, support, and contributions to evolve fullmoon.
• Contact and Engagement:
  • Twitter: @mainframe
  • Website: mainfra.me
  • Email for collaboration: careers@mainfra.me