Concept
Text classification
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Databricks Certified Generative AI Engineer Associate
Batch inference using Foundation Model APIs - Azure Databricks
Learn how to do batch inference using a provisioned throughput endpoint.
Tutorial: Deploy and query a custom model
Learn the overview and basic steps for performing model serving on Databricks.
Fine Tune your LLMs with Mosaic AI Model Training
dbdemos - Databricks Lakehouse demos : Fine Tune your LLMs with Mosaic AI Model Training
LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX
dbdemos - Databricks Lakehouse demos : LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX
Tutorials | Databricks
Discover the power of Lakehouse. Install demos in your workspace to quickly access best practices for data ingestion, governance, security, data science and data warehousing.
Databricks Generative AI Cookbook — Databricks Generative AI Cookbook
UX/UIAn all-in-one CLI app to run LLMs locally
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
Tools
My Journey towards “Databricks Certified Generative AI Engineer Associate”
My experiences from preparing for and successfully passing the (beta) exam
The GraphRAG Manifesto: Adding Knowledge to GenAI - Graph Database & Analytics
Discover why GraphRAG will subsume vector-only RAG and emerge as the default RAG architecture for most use cases.
Concept
Tutorial
GraphRAG: New tool for complex data discovery now on GitHub
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub. Learn more:
Package
Alex Strick van Linschoten - How to think about creating a dataset for LLM finetuning evaluation
I summarise the kinds of evaluations that are needed for a structured data generation task.
Fine-Tuning
Aligning LLM-as-a-Judge with Human Preferences
Deep dive into self-improving evaluators in LangSmith, motivated by the rise of LLM-as-a-Judge evaluators plus research on few-shot learning and aligning human preferences.
Design Pattern
Roadmap: AI Infrastructure
Read our roadmap on the next wave of enterprise data software in the age of AI.
Infrastructure
Applied LLMs - What We’ve Learned From A Year of Building with LLMs
A practical guide to building successful LLM products, covering the tactical, operational, and strategic.
Deep Dive
Using DuckDB for Embeddings and Vector Search
Machine learning, Scala, and interactive computing
Design Pattern
The architecture of today's LLM applications
Here’s everything you need to know to build your first LLM app and problem spaces you can start exploring today.
Concept
An interview with the most prolific jailbreaker of ChatGPT and other leading LLMs
Pliny the Prompter has been finding ways to jailbreak, or remove the prohibitions and restrictions on leading LLMs, since last year.
Security
Announcing LangChain RAG Template Powered by Redis - Redis
Explore the new LangChain RAG Template with Redis integration. Streamline AI development with efficient, adaptive APIs.
Example
Building an AI Agent With Memory Using MongoDB, Fireworks AI, and LangChain | MongoDB
Creating your own AI agent equipped with a sophisticated memory system. This guide provides a detailed walkthrough on leveraging the capabilities of Fireworks AI, MongoDB, and LangChain to construct an AI agent that not only responds intelligently but also remembers past interactions.
Memory
LlamaIndex: RAG Evaluation Showdown with GPT-4 vs. Open-Source Prometheus Model — LlamaIndex, Data Framework for LLM Applications
LlamaIndex is a simple, flexible data framework for connecting custom data sources to large language models (LLMs).
Example
Prompt Tuning With PEFT. - Hugging Face Open-Source AI Cookbook
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Using LLM-as-a-judge 🧑⚖️ for an automated and versatile evaluation - Hugging Face Open-Source AI Cookbook
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
TutorialRAG Evaluation - Hugging Face Open-Source AI Cookbook
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
How We Saved 10s of Thousands of Dollars Deploying Low Cost Open Source AI Technologies At Scale with Kubernetes
Scaling up generative AI operations can be costly. At OpenSauced, we faced this challenge while building StarSearch, until we found a low cost solution to deploy an OpenAI-compatible API using open source technology.
Prompt Engineering Roadmap - roadmap.sh
Step by step guide to learn Prompt Engineering. We also have resources and short descriptions attached to the roadmap items so you can get everything you want to learn in one place.
Prompt Engineering