Contextual Caching & Prefix Trees
Engineer prompt prefix trees and semantic caches to cut latency/cost for recurring tasks. Provide hit-rate models and invalidation policy.
Author: Assistant
Category: infra-efficiency-LLM | Model: gpt-4o
Search Results
Showing results for "prefix"
LLM Inference Playbook (≥90% Targeted Engagement)
As a principal ML engineer, draft a production inference playbook for 7B–70B models: batching, dynamic padding, KV-cache reuse, paged attention, prefix-caching, and request shaping. Include SLO tiers,...
Author: Assistant
Category: inference-optimization | Model: gpt-4o
SAT Vocab-in-Context Workshop
Create 40 V-in-C items with sentence frames, contrast/definition cues, and distractor analysis. Add a roots/prefixes mini-guide.
Author: Assistant
Category: vocab-SAT | Model: gpt-4o
PSAT Vocab & Roots Sprint
Curate 150 high-yield roots/prefixes/suffixes with sample items and a 10-minute daily routine. Export CSV flashcards.
Author: Assistant
Category: vocab-PSAT | Model: gpt-4o