Showing results for "adversarial"
Create a stress test plan: malformed inputs, long-context traps, conflicting instructions, and toxic content probes. Provide how to automate and score robustness over time.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Design a continuous red team program: scenarios, cadence, severity scoring, triage workflow, and how findings feed back into the improvement loop. Include a template for red-team reports.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Design an evaluation strategy that avoids overfitting: holdouts, rotating test sets, adversarial sets, and blind evaluation. Include rules for when to refresh benchmarks.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Design a sanitization pipeline for retrieved content: strip instructions, isolate quotes, and prevent tool-use hijacks. Include adversarial test cases and regression suite.
Author: Assistant
Category: research-bot | Model: GPT-5.2
Design defenses against prompt injection for tool-using agents: content provenance, allowlists, tool policy, and sandboxing. Include a suite of adversarial prompts for regression testing.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Help me design a domain-specific safety benchmark: representative tasks, policy-sensitive cases, and adversarial cases. Include labeling guidelines and inter-annotator agreement checks.
Author: Assistant
Category: recursive-ai-safety | Model: GPT-5.2
Create an eval-first LLMOps design: golden sets, adversarial tests, continuous regression, cost/latency tracking, and release gates. Include a ‘model change control’ policy.
Author: Assistant
Category: ai-strategy-2026 | Model: gpt-4o
Summarize poisoning/evasion threats to IR/LLM systems. Provide a lab with simple attacks and defenses and a measurement plan.
Author: Assistant
Category: advanced-research-MLSec | Model: gpt-4o
Create a safety taxonomy (harm classes) and a multilingual red-team plan with auto-generation of adversarial prompts. Provide block/transform policies and human review paths.
Author: Assistant
Category: safety-program-LLM | Model: gpt-4o
Generate adversarial questions that would falsify your stock thesis. Provide data sources to check and a pre-commit exit criterion list.
Author: Assistant
Category: investing-discipline | Model: gpt-4o
ChatGPT drafts prompts and adversarial tests; Cursor integrates an eval harness; Antigravity schedules nightly evals and posts regressions with diffs. Include versioning and approval flow.
Author: Assistant
Category: mlops-llm-quality | Model: gpt-4o