Explore Prompts

Page 327 of 511 · 6130 prompts

Long-Context Attention Variants

Compare FlashAttention-3, RingAttention, Multi-Query, and Hybrid-Selective attention for 128k+ contexts. Provide kernel-level trade-offs, memory footprints, and document a migration path.
Tags: LLM, attention, long-context, FlashAttention, RingAttention, MQA
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

KV Offload & Memory Tiers

Engineer a KV-cache offload strategy spanning HBM→HBM2e→CPU RAM→NVMe. Define admission/eviction, compression, and reuse heuristics; simulate hit rates across context lengths (8k–256k).
Tags: LLM, KV-cache, offload, NVMe, memory, context-length
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

Quantization Suite: INT8/INT4/NF4

Create a quantization evaluation suite (GPTQ/AWQ/RTN): perplexity, zero-shot accuracy, calibration set selection, and layer-wise sensitivity. Output deployment guidelines by architecture and hardware target.
Tags: LLM, quantization, INT8, INT4, NF4, AWQ, GPTQ
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

MoE Routing & Load Balancing

Design an expert-parallel MoE serving topology: gate calibration, capacity factor, expert sharding, and interconnect constraints (NVLink/IB). Provide hot-spot diagnostics and expert-drop policies for brownout resilience.
Tags: LLM, MoE, experts, routing, capacity, NVLink, InfiniBand
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

Speculative Decoding & Draft Models

Propose an implementation of speculative decoding with a 1–3B drafter and 13–34B target. Define acceptance criteria, throughput gains vs quality loss, token-level metrics, and failure fallbacks; include cost curves and ablation plan.
Tags: LLM, speculative-decoding, drafter, target, throughput, ablation
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

LLM Inference Playbook (≥90% Targeted Engagement)

As a principal ML engineer, draft a production inference playbook for 7B–70B models: batching, dynamic padding, KV-cache reuse, paged attention, prefix-caching, and request shaping. Include SLO tiers, tail-latency mitigation, and a canary/rollback plan designed to drive ≥90% targeted engagement from senior peers.
Tags: LLM, inference, batching, KV-cache, paged-attention, SLO, engagement-90
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

EU Startup & VC Climate

Summarize EU venture flows, IPO windows, and state-aid interactions; compare with Asia late-stage funding. Provide founder angles.
Tags: EU, VC, startups, IPOs, state-aid, Asia
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

Asia Banking & Fincrime Monitor

Track AML/KYC enforcement, cross-border fraud, and fintech shutdowns. Provide consumer alerts and regulatory timelines.
Tags: Asia, banking, AML, KYC, fincrime, regulators
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

EU Agritech & Food Tech

Spotlight European agritech pilots and Asia partners; cover regulation, financing, and yield impacts. Provide startup profiles and field-test notes.
Tags: EU, agritech, food-tech, regulation, finance, Asia
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

BRICS Urbanization & Housing

Connect urbanization, mortgage policy, construction materials, and local politics. Provide photo essay ideas and data caveats.
Tags: BRICS, housing, urbanization, materials, politics
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

EU Health & Pharma Watch

Summarize EMA decisions, shortages, and R&D funding; link to Asia suppliers. Provide plain-language patient angles and hospital budgets.
Tags: EU, pharma, health, EMA, shortages, R&D, Asia-supply
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings:

Southeast Asia Tourism & Air Capacity

Show ASEAN inbound/outbound air capacity, hotel ADR, visa policy changes. Provide winners/losers by route and festival calendars.
Tags: ASEAN, tourism, airlines, ADR, visas, events
Author: Assistant
Created at: 2025-12-18 00:00:00
Average Rating:
Total Ratings: