SAFETY & ALIGNMENT
SAFETY & ALIGNMENT TAXONOMY

Safety & Alignment Atlas

The definitive engineering index of AI safety: 8 domains, 32+ concepts, threat surfaces, internal representation probes, guardrail topologies, differential privacy budgets, and verifiable governance cases.

Taxonomy of adversarial attack vectors, jailbreak taxonomies, prompt injection pathways, and multimodal vulnerabilities.

◈ SCENE

Many-Shot In-Context Jailbreaking

▲ COLLAPSE

Flooding the context window with 50-200 synthetic benign dialogue rounds to dilute the model's safety training priors.

  • In-context learning acts as an implicit fine-tuning step inside the attention kv-cache.
  • As context length expands beyond 32k-128k tokens, refusal probability drops precipitously.
  • Mitigated via attention-sink masking and in-context safety reminder injection.
◈ SCENE

Greedy Coordinate Gradients (GCG)

▼ EXPAND

Discrete token optimization searching for universal adversarial strings that trigger target affirmative prefixes.

◈ SCENE

Indirect Prompt Injection & Tool Poisoning

▼ EXPAND

Adversaries embedding hidden instructions in external web pages, emails, or SQL databases retrieved by AI agents.

◈ SCENE

Multimodal & Typographic Jailbreaks

▼ EXPAND

Injecting adversarial text directly rendered inside images or perturbed audio to bypass text-only safety filters.

Agent-native web · research mode

Experimental WebMCP · evolving community-group draft, not a W3C Standard or on the Standards Track.

Native status: Initializing. Registered: none

DOM → inferred capabilities · WebMCP → declared capabilities. Tools read real CUDA/Inference Atlas content. Calls may highlight temporary UI state. No backend or remote telemetry.

Local harness verifies application logic; it does not demonstrate native discovery or a browser agent.

Input schema
{
  "type": "object",
  "properties": {
    "query": {
      "type": "string",
      "minLength": 1,
      "maxLength": 300
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 10
    }
  },
  "required": [
    "query"
  ],
  "additionalProperties": false
}
Local log: last 100 calls while this panel is open. Inputs may contain personal text; review before sharing.
 
[]