#gpu-kernels#memory-bandwidth#llm-training
Autonomous roofline-guided GPU kernel optimization. Profiles whether a kernel is compute- or memory-bound, proposes a hypothesis from the optimization guide, modifies the kernel, benchmarks against the reference, and iterates — committing, benchmarking, and reverting autonomously.
[[source]] ↗#llm-training#retrieval#benchmarks#applied-agents
Context assembly for LLM code repair under strict token budgets. Parses Python repos into a knowledge graph (AST → calls, imports, inheritance), runs BM25/dense/BCA retrieval, assembles context that fits the budget, and measures whether better retrieval actually fixes more bugs.
[[source]] ↗#bayesian-inference#scientific-computing#astrophysics#retrieval
Calibration-first retrieval stack for exoplanet atmospheres + NEOs. Forward-model wrappers, opacity ensembles, contamination latents, and reproducible inference in one package.
[[source]] ↗#reinforcement-learning#benchmarks#applied-agents#evaluation
Reproducible, evaluable reinforcement learning environments for training agents on computer-use tasks. Structured framework for generating diverse task batches, running sandboxed episodes, and scoring agent performance.
[[source]] ↗#model-compression#quantization#llm-training#efficiency
Activation-aware compression for transformer models. Profiles which attention heads and MLP neurons are most active on your data distribution, then applies more aggressive compression to dormant ones — better task-specific quality at the same compression ratio.
[[source]] ↗#reinforcement-learning#applied-agents#social-dilemmas#benchmarks#multi-agent-learning
Multi-agent simulation measuring LLM strategic behavior in resource competition under asymmetric information and institutional constraints.
[[source]] ↗#vector-search#databases#ivf-indexing#object-storage
Object-storage-first hybrid search engine w/ IVF vector search + BM25 full‑text with metadata filters, immediate write visibility via a hot index, and async merge to an S3‑backed cold index. Features adaptive nprobe, NVMe caching, and RRF fusion for robust relevance.
[[source]] ↗#mechanistic-interpretability#in-context-learning#transformer-architecture#attention-mechanisms
Mech interp playground for tracking ICL emergence and induction heads. Built to understand what transformers actually learn during in-context learning.
[[source]] ↗#distributed-training#parallelism#fsdp#gpu-kernels
Minimal FSDP implementation. Stripped down to the essentials so you can actually see how parameter sharding works under the hood.
[[source]] ↗#gpu-kernels#memory-bandwidth
CUDA-accelerated BM3D denoising. Gets you ~20% speedup over OpenCV and handles real-time video.
[[source]] ↗#vector-search#databases#hnsw-indexing
Vector db built from scratch. HNSW, KD-tree, IVF- multiple indexing strategies with proper metadata filtering because most vector DBs overcomplicate the basics.
[[source]] ↗