Showing results for "KV-cache"
Design an agent that optimizes tail latency: identify bottlenecks, reduce contention, add caching, and validate with load tests. Track p95/p99 improvements.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Create a cost-aware policy: budgets per run, per tool call, and per environment. Require justification for expensive steps and optimize via caching and routing.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Create an agent to optimize CI time: caching, test sharding, and selective runs while preserving safety. Include a policy to prevent skipping critical tests.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design an agent that reduces third-party API spend via caching, batching, and smarter fallbacks, while preserving correctness. Include cost dashboards and guardrails.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Create a blueprint to add fallbacks when external APIs fail: cached responses, alternative providers, and graceful degradation. Include policy for when to fail fast.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Create a blueprint to improve build scripts safely: hermeticity, caching, parallelism, and reproducibility. Require staged validation and rollback.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Create a documentation crawler for self-improvement research that respects robots.txt, rate limits, and TOS. Include caching, dedupe, and citation storage.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Create an agent to tune caches: TTLs, invalidation, and hit rates. Require correctness proofs, stale data detection, and rollback thresholds.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design an internal code search agent: symbol indexing, call graphs, and test mapping to propose the smallest correct edit surface. Include caching and explainability.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design storage: raw HTML, cleaned text, metadata, embeddings, and caches. Include schema, retention rules, and how to support reprocessing when extractors improve.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Design cost controls: budget caps, queue prioritization, cache policy, and abort rules for expensive runs. Include a method to estimate ROI of improvements before executing.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Design two operating modes: news (high freshness, fast) vs evergreen (depth, books/papers). Include different source scoring, caching, and output formats.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Design an end-to-end architecture for a research bot that uses web search APIs, page fetching, and summarization. Include modules, data flow, storage, caching, and citation strategy.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Design caching: query result caches, page caches, and embedding caches. Include invalidation rules based on freshness requirements and how to prevent stale conclusions.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Plan a resilient fetching layer: retries, exponential backoff, timeouts, caching, and content-type handling. Include how to avoid hammering sites and manage 429/503 responses.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Design caching layers: retrieval cache, tool result cache, and response cache. Include invalidation rules, privacy constraints, and how to measure cache hit value.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Create a latency plan: streaming, speculative execution, parallel tool calls (safe), caching, and progressive disclosure. Include how to avoid race-condition errors and maintain correctness.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Given target throughput, latency, power, area, and interfaces, produce a trade study that maps requirements to candidate microarchitectures (pipeline vs iterative, SIMD vs systolic, cache vs scratchpa...
Author: Assistant
Category: fpga-asic-design | Model: gpt-4o
Given workload and bandwidth, choose cache hierarchy vs scratchpad. Provide coherence implications, DMA model, and verification complexity tradeoffs. Include performance modeling approach.
Author: Assistant
Category: fpga-asic-design | Model: gpt-4o
Draft a 2026 cost engineering playbook: caching, quantization, distillation, batching, and SLA tiers. Provide a KPI dashboard linking cost per task to business outcomes.
Author: Assistant
Category: ai-strategy-2026 | Model: gpt-4o
Engineer a KV-cache offload strategy spanning HBM→HBM2e→CPU RAM→NVMe. Define admission/eviction, compression, and reuse heuristics; simulate hit rates across context lengths (8k–256k).
Author: Assistant
Category: systems-architecture-LLM | Model: gpt-4o
As a principal ML engineer, draft a production inference playbook for 7B–70B models: batching, dynamic padding, KV-cache reuse, paged attention, prefix-caching, and request shaping. Include SLO tiers,...
Author: Assistant
Category: inference-optimization | Model: gpt-4o
Engineer prompt prefix trees and semantic caches to cut latency/cost for recurring tasks. Provide hit-rate models and invalidation policy.
Author: Assistant
Category: infra-efficiency-LLM | Model: gpt-4o
Design a mobile UX with offline packs, low-bandwidth retrieval, and later sync. Provide caching TTL, conflict resolution, and share sheet flows.
Author: Assistant
Category: mobile-experience | Model: gpt-4o
Design a DAG (Airflow/Prefect) for reproducible research: crawl→retrieve→synthesize→verify→export. Include artifact hashing and cache invalidation rules.
Author: Assistant
Category: ops-pipelines-research | Model: gpt-4o
ChatGPT proposes caching/connection pool/async patterns; Cursor wires benchmark harness; Antigravity runs comparative tests and recommends configs per environment.
Author: Assistant
Category: backend-optimization | Model: gpt-4o
Have ChatGPT propose pipeline concurrency, caching, and test sharding; Cursor edits YAML/pipelines; Antigravity times stages and suggests cache keys. Output a before/after chart.
Author: Assistant
Category: pipeline-engineering | Model: gpt-4o
Implement a semantic cache for repeated queries and a de-dup stage to collapse near-duplicate sources. Provide hit/miss metrics and eviction policy.
Author: Assistant
Category: performance-cache | Model: gpt-4o
Build a CLI to clean temp folders, browser caches, and build artifacts with a whitelist and dry-run report. Flags: --scope dev|browsers|system, --days-old, --dry-run, --clean.
Author: Assistant
Category: cli-tool | Model: gpt-4o
Provide a CLI that fetches FX rates (curl to public API) with on-disk caching and offline fallback. Flags: --from JPY --to USD --amount 12000, --vat 10. Print breakdown neatly.
Author: Assistant
Category: cli-tool | Model: gpt-4o
Act as a sustainability lead. Create a carbon-aware compute plan: profiler for energy, spot/preemptible policies, caching, data locality, and reporting. Include a ‘green score’ rubric.
Author: Assistant
Category: HPC-ops | Model: gpt-5
Act as a mentor. Map 10 classic DSA problems to real product tasks (caching, search, graph features). Provide project ideas, metrics, and code-review checklists.
Author: Assistant
Category: education | Model: gpt-4o
Propose a chiplet SoC using UCIe 1.1 over 2.5D interposer: partitioning rationale, die-to-die bandwidth/latency budget, PHY choices, protocol mapping, cache-coherency options, test strategy, and yield...
Author: Assistant
Category: chip-design | Model: gpt-4
Propose how to split compute between CPU, GPU, and QPU for a variational algorithm. Provide a pipeline diagram description, and give heuristics for batching, latency hiding, and caching parameter shif...
Author: Curioforce Corp. Corp.
Category: Quantum Tech | Model: gpt-5-thinking
If geospatial features exist, design overlays for green corridors, tree canopy, and sensitive habitats. Plan: data sources, caching, offline mode, and respectful UX. Add a policy to avoid enabling har...
Author: Tsubasa Kato
Category: geospatial | Model: gpt-5-thinking
Update SRE program for climate risks. Scenarios: heat, floods, wildfires, outages. Plan: region failover, brownout modes, cache-first read, comms templates, drills. Add recovery time targets and user ...
Author: Tsubasa Kato
Category: reliability | Model: gpt-5-thinking
Optimize on-device inference for {{model}} on {{chipset}}. Techniques: quantization (int8/4), sparsity, operator fusion, caching, batching, scheduler tweaks. Report latency/energy tradeoffs and a roll...
Author: Tsubasa Kato
Category: performance | Model: gpt-5-thinking
Design a CI/CD pipeline that minimizes energy. Tactics: selective test runs, caching, artifact reuse, ephemeral environments, static analysis gates, and carbon-intensity-aware scheduling. Add SLOs and...
Author: Tsubasa Kato
Category: devops | Model: gpt-5-thinking
Architect secure RAG across lakehouse/DWH: metadata-driven retrieval, policy-aware chunks, per-record ACL, caching, eval sets by domain, hallucination controls, and can’t-answer routing. Deliver refer...
Author: Tsubasa Kato
Category: Strategy | Model: GPT-5 Thinking