CWE-1426: Improper Validation of Generative AI Output
ID
CWE-1426
Abstraction
Base
Structure
Simple
Status
Incomplete
The product invokes a generative AI/ML
component whose behaviors and outputs cannot be directly
controlled, but the product does not validate or
insufficiently validates the outputs to ensure that they
align with the intended security, content, or privacy
policy.
Modes of Introduction
| Phase | Note |
|---|---|
| Architecture and Design | Developers may rely heavily on protection mechanisms such as input filtering and model alignment, assuming they are more effective than they actually are. |
| Implementation | Developers may rely heavily on protection mechanisms such as input filtering and model alignment, assuming they are more effective than they actually are. |
Applicable Platforms
| Type | Class | Name | Prevalence |
|---|---|---|---|
| Language | Not Language-Specific | ||
| Architecture | Not Architecture-Specific | ||
| Technology | AI/ML | ||
| Technology | Not Technology-Specific |
Loading...