Showing results for "offline-evals"
Create a loop where production failures and near-misses become new eval tests. The agent should propose test additions with minimal reproductions and acceptance criteria.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design retrieval that avoids irrelevant context: recency weighting, scope filters, and contradiction detection. Include evals for context precision/recall.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Build an eval harness for self-edits: deterministic tool mocks, seeded randomness, replayable runs, and stored artifacts for auditing decisions.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design a prompt library that the agent can improve safely: semantic versioning, eval gates, canary prompts, and rollback. Include prompt linting rules.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design a plan to self-improve ranking/retrieval safely: offline eval sets, interleaving/AB tests, bias checks, and rollback on metric drops.
Author: Assistant
Category: safe-self-improving-ai | Model: gpt-5.2
Design an AgentOps platform: deployment, permissions, observability, evals, and compliance reporting. Include buyer personas and monetization (seat vs usage).
Author: Assistant
Category: future-monetization | Model: gpt-5.2
Design a Life OS product: calendar, tasks, email drafting, and delegation. Include privacy-by-design, offline-first options, and monetization tiers.
Author: Assistant
Category: future-monetization | Model: gpt-5.2
Design products for low-bandwidth contexts: offline-first, SMS/USSD, low compute. Include distribution strategies and pricing aligned to local purchasing power.
Author: Assistant
Category: future-monetization | Model: gpt-5.2
Design a ranking formula: lexical relevance, semantic similarity, trust score, freshness decay, and diversity penalty. Include how to tune weights and validate offline/online.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Design an evaluation strategy that avoids overfitting: holdouts, rotating test sets, adversarial sets, and blind evaluation. Include rules for when to refresh benchmarks.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Design an offline sandbox environment for experimenting with improvements: isolated data, limited tools, no external side effects, and deterministic replay. Provide a checklist for containment.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Create a policy and technical controls for PII/secrets: detection, redaction, encryption, and safe storage. Include test cases and a plan to prevent secret leakage into training/evals.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Generate a model/system card template: intended use, limitations, safety mitigations, eval results, and known failure modes. Include a changelog section for each iteration.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Design a connectivity plan for experienced travelers: eSIM, local SIM, roaming, offline maps, VPN basics, and backup communication. Include options for budget and luxury convenience.
Author: Assistant
Category: world-travel-planning | Model: GPT-5.2
Design an offline navigation method: storing maps, landmark routing, and writing a simple “route card.” Emphasize safety and avoiding unnecessary risk.
Author: Assistant
Category: off-grid-survival | Model: GPT-5.2
Create an offline document backup system for world travel: passport copies, visas, tickets, insurance, emergency contacts, and encrypted digital storage. Include a printed backup checklist.
Author: Assistant
Category: world-travel-planning | Model: GPT-5.2
Give me an offline information plan: what physical references to keep (manuals, standards, maps), how to organize them, and how to keep them updated.
Author: Assistant
Category: information-reliability | Model: GPT-5.2
Create a method for offline verification: who to call, what to ask, how to document, and how to avoid rumor amplification. Include scripts.
Author: Assistant
Category: information-reliability | Model: GPT-5.2
Help me assemble a compact offline field manual for trustworthy information: emergency numbers, key references, maps, and verification checklists. Provide a table of contents and print format.
Author: Assistant
Category: information-reliability | Model: GPT-5.2
Create an offline navigation plan: how to store maps, choose landmark-based routes, and avoid risky areas. Keep advice general and safety-focused.
Author: Assistant
Category: emergency-preparedness | Model: gpt-4o
Create a method to map essentials near me (water, pharmacy, clinic, shelter, charging). Include offline storage, update cadence, and a simple map legend.
Author: Assistant
Category: off-grid-survival | Model: GPT-5.2
Create a method to map essential resources near me: clinics, pharmacies, water points, shelters, and charging spots. Include how to keep the map offline and updated.
Author: Assistant
Category: emergency-preparedness | Model: gpt-4o
Create a template to localize emergency numbers, local authority resources, and medical contacts for Europe/Asia/USA/Africa countries. Include a method to keep it updated and accessible offline.
Author: Assistant
Category: preparedness | Model: gpt-4o
Provide a phone readiness checklist: emergency alerts, battery optimization, offline maps, important contacts, medical ID, and a “low power” routine.
Author: Assistant
Category: emergency-preparedness | Model: gpt-4o
Create a productivity plan for working while traveling by ship, train, and airplane. Include offline work blocks, power planning, connectivity assumptions, and recovery days.
Author: Assistant
Category: world-travel-planning | Model: GPT-5.2
Create a business data continuity plan: backups, credential management, offline access, and team communication. Keep it operational and non-technical where possible.
Author: Assistant
Category: emergency-preparedness | Model: gpt-4o
Build a small phrasebook and translation strategy for travelers/residents: medical, transport, and safety phrases; offline translation tips; and how to communicate clearly under stress.
Author: Assistant
Category: preparedness | Model: gpt-4o
Design a budget remote-work travel setup: reliable cafés, libraries, coworking day passes, offline work planning, and low-cost connectivity. Include power and noise management.
Author: Assistant
Category: world-travel-planning | Model: GPT-5.2
Create a digital continuity plan: secure backups of IDs, insurance, contacts, and essential files; offline access; password manager hygiene; and device charging priorities. Keep it practical and priva...
Author: Assistant
Category: preparedness | Model: gpt-4o
Create a 90-day plan to build a high-capability agent system using MCP and A2A: milestones, architecture decisions, eval harness, safety gates, and a pilot deployment. Include staffing assumptions and...
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Create a safe synthetic task generation plan: avoid sensitive content, prevent leakage, and validate usefulness with human review. Include how to measure whether synthetic tasks improve real outcomes.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Define specialist agent roles with distinct prompts, tools, and constraints. Provide handoff rules and an evaluation plan to ensure specialists outperform a monolith.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Design a RAG pipeline for agents: retrieval, citation, cross-checking, and contradiction handling. Provide an evaluation plan to measure hallucination reduction and tool-call accuracy.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Design an eval harness: deterministic replays, seeded randomness, fixed tool mocks, and artifact snapshots. Provide a folder structure and CI integration plan.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Design a safe self-improvement loop for prompts/tools: propose change, run evals, red-team, canary, deploy, monitor. Include stop rules and audit artifacts.
Author: Assistant
Category: agent-architecture | Model: GPT-5.2
Produce a 100-day plan: quick wins, foundational work (governance/evals), first agent rollout, security controls, and stakeholder cadence. Include a weekly operating rhythm and deliverables.
Author: Assistant
Category: ai-strategy-2026 | Model: gpt-4o
Create an eval-first LLMOps design: golden sets, adversarial tests, continuous regression, cost/latency tracking, and release gates. Include a ‘model change control’ policy.
Author: Assistant
Category: ai-strategy-2026 | Model: gpt-4o
Specify endpoints for query, suggestion, and feedback. Include schema examples, rate limits, and offline evaluation hooks.
Author: Assistant
Category: capstone-spec-IR | Model: gpt-4o
Design an evaluation harness that measures relevance and faithfulness for IR+LLM answers. Include human labeling rubric and inter-rater checks.
Author: Assistant
Category: eval-framework-IR-LLM | Model: gpt-4o
Create a senior-grade eval battery: reasoning (math/code), instruction-following, safety, multilingual QA, and tool-use. Include uncertainty intervals and power analysis for A/Bs.
Author: Assistant
Category: evaluation-design-LLM | Model: gpt-4o
Build an eval harness: recall@k, calibrated precision, answer faithfulness, and human-time-to-verify. Include topic-aware test buckets and data drift alarms.
Author: Assistant
Category: evaluation-frameworks-LLM | Model: gpt-4o
Write a data governance spec: license screening, PII scrubbing, near-duplicate collapse, contamination checks vs eval sets, and audit trails. Provide rejection reasons and exception handling.
Author: Assistant
Category: data-operations-LLM | Model: gpt-4o
Specify a training stack with SFT on curated data, preference optimization (DPO/ORPO), and optional RLHF. Include reward hacking tests, guardrails, and evals that predict production behavior.
Author: Assistant
Category: training-pipeline-LLM | Model: gpt-4o
Deliver a low-bandwidth strategy for Lanzhou (ZH): text-first carousels, offline packs, and SMS/WeChat hybrid. Target ≥70% predicted engagement.
Author: Assistant
Category: west-cn-outreach-lowdata | Model: gpt-4o
Distill a 70B teacher into a 7–13B student: loss mixing (logits+features+policies), curriculum, and temperature tuning. Provide downstream eval deltas.
Author: Assistant
Category: model-compression-training | Model: gpt-4o
Outline a privacy strategy: DP-SGD variants for SFT, selective redaction layers, privacy evals (membership inference), and logging minimization.
Author: Assistant
Category: privacy-engineering-LLM | Model: gpt-4o
Define motion and interaction for tablet/phone editions: scrollytelling, parallax rules, tap targets, and offline reading. Provide component library specs.
Author: Assistant
Category: digital-UX-system | Model: gpt-4o
Create a pipeline that generates questions from documents, with required answer spans and citations. Provide filters for ambiguity and leakage checks.
Author: Assistant
Category: data-generation-eval | Model: gpt-4o
Build an eval that scores ground-truth attribution (exact passage match), answer faithfulness, and coverage. Provide dataset schema and a nightly regression plan.
Author: Assistant
Category: evaluation-frameworks | Model: gpt-4o
ChatGPT drafts prompts and adversarial tests; Cursor integrates an eval harness; Antigravity schedules nightly evals and posts regressions with diffs. Include versioning and approval flow.
Author: Assistant
Category: mlops-llm-quality | Model: gpt-4o
Train an LTR model to order passages by usefulness. Define features (BM25, dense score, novelty, redundancy), labels, and offline/online eval plan.
Author: Assistant
Category: retrieval-ranking-ml | Model: gpt-4o
Design a mobile UX with offline packs, low-bandwidth retrieval, and later sync. Provide caching TTL, conflict resolution, and share sheet flows.
Author: Assistant
Category: mobile-experience | Model: gpt-4o
Create a layered nav plan: map/compass refreshers, GPX file prep, offline app setup, backup wayfinding cues. Include a 10-question nav quiz and a pocket crib sheet.
Author: Assistant
Category: navigation-skills | Model: gpt-4o
Design a connectivity plan per country with eSIM recommendations, dual-SIM failover, offline maps, and airport pickup options. Add battery and hotspot etiquette tips.
Author: Assistant
Category: tech-basics-travel | Model: gpt-4o
Provide a CLI that fetches FX rates (curl to public API) with on-disk caching and offline fallback. Flags: --from JPY --to USD --amount 12000, --vat 10. Print breakdown neatly.
Author: Assistant
Category: cli-tool | Model: gpt-4o
Write a CLI to convert times and propose overlaps between cities. Flags: --from '2025-12-01 09:00 JST', --to 'PST,IST', --overlap 60m, --weekview. Offline tzdb bundled.
Author: Assistant
Category: cli-tool | Model: gpt-4o
You are an ML researcher. Propose an offline RL study using simulators: state/action design, causal concerns, OPE (IPS/DR), safety constraints, and prospective evaluation plan.
Author: Assistant
Category: ml-methods-health | Model: gpt-5
You are an embedded AI lead. Design an edge pipeline for POC devices: on-device inference, quantization, latency budgets, offline fallback, and remote update policy. Include safety/alerting tests.
Author: Assistant
Category: medical-devices-ICT | Model: gpt-5
Act as a mobile ops coach. Provide battery/data-saving rules for long commutes: offline-first, background refresh policy, low-data media, and emergency reserve. Output a checklist.
Author: Assistant
Category: operations | Model: gpt-5
You are a DAM architect. Create a 3-2-1 backup plan, folder schema, file naming convention, and IPTC keyword strategy. Include cloud and offline options plus a restore drill.
Author: Assistant
Category: photography | Model: gpt-4o
Create a lint checklist for prompts: brevity, unambiguous instructions, schema-first outputs, guardrails, and eval hooks. Return a checklist table with yes/no and examples. Add 5 before→after rewrites...
Author: Curioforce Corp. Corp.
Category: Prompt-Improvement | Model: gpt-5-thinking
If geospatial features exist, design overlays for green corridors, tree canopy, and sensitive habitats. Plan: data sources, caching, offline mode, and respectful UX. Add a policy to avoid enabling har...
Author: Tsubasa Kato
Category: geospatial | Model: gpt-5-thinking
List risks for {{AI_use_case}} (medical/fitness/environmental). Design mitigations: human-in-the-loop, disclaimers, confidence prompts, and fail-safes. Add an evaluation plan with red-team tests and m...
Author: Tsubasa Kato
Category: risk | Model: gpt-5-thinking
Propose energy-saving defaults and power modes for {{app_or_device}}. Include low-power UI states, background task limits, offline-first options, and user education. Add a toggle policy and telemetry ...
Author: Tsubasa Kato
Category: product | Model: gpt-5-thinking
You are a robotics CI lead. Design a sim-in-the-loop pipeline for perception + planning stacks. Deliver: scenario library spec (lighting, occlusion, rare edge cases), metrics (success %, collision=0, ...
Author: Tsubasa Kato
Category: Engineering | Model: GPT-5 Thinking
Write an ITIL-aligned process for agent incidents and changes: severity matrix, rollback, shadow traffic, canary, approvals, comms templates, and post-mortems with eval deltas. Include regulator-ready...
Author: Tsubasa Kato
Category: Strategy | Model: GPT-5 Thinking
Design a data-lite RAG plan without engineers. Sources: Google Drive/Notion/PDFs. Deliver: folder taxonomy, redaction rules, ingestion checklist, embedding strategy, update cadence, eval set of 25 Q&A...
Author: Tsubasa Kato
Category: Strategy | Model: GPT-5 Thinking
Ship marketing and sales agents: content brief generator, SEO outline, ad variants, webinar follow-up, lead enrichment, meeting note sync. Define prompts, tool chain (CRM, MAP, docs), eval rubric (bra...
Author: Tsubasa Kato
Category: Strategy | Model: GPT-5 Thinking
Design an orchestration layer for 5–10 agents: routing, memory, tool auth, retries, tracing, and guardrails. Compare options (workflow engines vs. code), propose SLAs, queues, circuit breakers, and ob...
Author: Tsubasa Kato
Category: Strategy | Model: GPT-5 Thinking
Architect secure RAG across lakehouse/DWH: metadata-driven retrieval, policy-aware chunks, per-record ACL, caching, eval sets by domain, hallucination controls, and can’t-answer routing. Deliver refer...
Author: Tsubasa Kato
Category: Strategy | Model: GPT-5 Thinking
Maps unavailable. Use landmark-based directions (highways, bridges, transit hubs). Photograph posted maps; write turn-by-turn on paper. Prefer well-lit, populated routes; avoid flooded areas, smoky tu...
Author: Tsubasa Kato
Category: Safety | Model: GPT-5 Thinking
GPS/maps degraded or offline. Navigation: switch to landmarks (stations, bridges, big roads); photo posted maps; write turns on paper; avoid dark alleys at night. Team sync: define primary/secondary r...
Author: Tsubasa Kato
Category: Safety | Model: GPT-5 Thinking
GPS/maps degraded or offline. Navigation: switch to landmarks (major roads, bridges, stations); photo posted maps; write turn-by-turn on paper; avoid unfamiliar alleys at night. Team sync: define prim...
Author: Tsubasa Kato
Category: Safety | Model: GPT-5 Thinking
Extended power loss causing comms failure. Priorities: avoid hazards, conserve power, maintain contact cadence. Actions: keep fridge closed; avoid candles (use flashlights); ventilate generators outdo...
Author: Tsubasa Kato
Category: Safety | Model: GPT-5 Thinking
You are CIVSAFE for large-scale internet/cellular outages. Goal: keep people coordinated, calm, reachable. Inputs: scenario, location, companions, constraints (battery/signal), intent. Output: SAFE-BR...
Author: Tsubasa Kato
Category: Safety | Model: GPT-5 Thinking
Design a store-traffic program using localized ads, store locator SEO, and promo codes to measure offline lift across regions.
Author: ChatGPT
Category: business | Model: gpt-5