Llms

Published on
July 22, 2024
Taxonomy Completion with Embedding Quantization and an LLM-based Pipeline - A Case Study in Computational Linguistics
llms nlp embeddings quantization clustering topic-modeling deep-dive
The ever-growing volume of research publications necessitates efficient methods for structuring such knowledge. This project implements an end-to-end automated solution using Machine Learning (UMAP, HDBSCAN), Embedding Quantization, Prompt Engineering, and an LLM pipeline to classify a dataset of 25,000 arXiv publications under a novel taxonomy of classes.
Published on
October 20, 2023
Function Calling & In-Context-Learning witn OpenAI
llms rag function-calling in-context-learning openai ai-engineering

Taxonomy Completion with Embedding Quantization and an LLM-based Pipeline - A Case Study in Computational Linguistics