GEOAgent Knowledge Base: An Integrated and Self-Contained Resource of SQLite Metadata, Vector Embeddings, and Local Re-ranking Models for Automated GEO Data Reuse
Authors/Creators
Description
Overview
This repository contains the core knowledge base for GEOAgent, an intelligent assistant designed to automate the discovery and analysis of biomedical datasets. The database integrates high-fidelity metadata from 180,000+ GEO series, 5 million+ samples, and 84,000+ PubMed abstracts (updated as of April 2026) into a multi-modal retrieval system.
Core Components
-
SQLite DB (Structured Metadata): A relational database optimized for high-speed filtering. It features a multi-table schema (including
gse_metadata,gsm_metadata, andpubmed_metadata) with B-tree indexing for range/equality queries and FTS5 indexing for full-text search of study titles and summaries. -
Vector DB (Semantic Embeddings): An unstructured knowledge store generated via Hierarchical Semantic Chunking (HSC). Using the Nomic Embed v2 model (768 dimensions), raw metadata is systematically partitioned into five distinct semantic zones to enable granular similarity matching, where
gse_corecaptures study design and research rationale,gse_sampleencompasses sample-specific metadata and clinical/biological attributes,gse_protocolextracts experimental protocols including sample treatment, growth, and extraction,gse_processingdocuments downstream data processing and computational workflows, andpub_coreincorporates rich bibliographic context via publication titles and abstracts. - BGE-Reranker (Deep Ranking): An industry-standard Cross-Encoder model (BAAI/bge-reranker-v2-m3) co-packaged to enable full offline execution. Deployed in the final stage of the hybrid retrieval pipeline, it performs deep semantic re-ranking of dataset candidates to guarantee the highest precision for complex natural language queries.
Technical Workflow Integration
The database is specifically engineered to support the GEOAgent 5-stage pipeline:
-
Intent Parsing: LLM-based extraction of research goals.
-
Hybrid Retrieval: Concurrent SQL Hard Filtering (for structured attributes) and Semantic Matching (for unstructured context).
-
Logical Filtering & Reranking: Final validation and precision sorting of results.
Application & Compatibility
bioStream—an industrialized, containerized Nextflow workflow platform—enabling automated and highly reproducible standardized processing for 6 major omics types: RNA-seq, scRNA-seq, ATAC-seq, scATAC-seq, ChIP-seq, and scMultiome.
-
Core Agent Software: GitHub - JiekaiLab/GEOAgent
-
Multi-Omics Processing Pipeline:
Files
Files
(9.7 GB)
| Name | Size | |
|---|---|---|
|
md5:2c432c8bff4f8e1c8655fec9046a9f6d
|
9.7 GB | Download |