Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 

README.md

Text Analysis

Analyze the collected literature: extract structured information, embed and cluster paper abstracts, and classify papers with local LLMs. The classification scripts also tune prompts and produce the labeled modeling_papers.json outputs.

Part of the genscai use-case series. Shared library code lives in the genscai package; datasets in data/ and generated artifacts in output/ are shared at the repo root.

Notebooks

# Notebook
01 01 - Information Extraction - OpenAI
02 02 - Information Extraction - LangChain
03 03 - Information Extraction - LangExtract
04 04 - Embeddings - Vector Search
05 05 - Embeddings - SPECTER
06 06 - Embeddings - SPECTER2
07 07 - Embeddings - NV-Embed
08 08 - Embeddings - Clustering and Visualization
09 09 - Classification - Local LLMs
10 10 - Classification - Prompt Evaluation

Scripts