A security analyst who is reviewing logs notices the following:
* Suspicious inputs are present and contain character look-alikes.
* Strange character substitutions
* Odd spacing
* Inputs that appear to be broken sentence structures
Which of the following best explains what the user was utilizing?
Obfuscation is the correct answer because the observed inputs show deliberate attempts to make content difficult for automated security controls or AI systems to interpret while preserving enough meaning for the intended recipient. Character look-alikes, unusual Unicode substitutions, abnormal spacing, and deliberately fragmented sentence structures are common techniques for disguising malicious or restricted content. CompTIA SecAI+ explicitly identifies obfuscation within the AI-assisted security domain as a way AI can enable or enhance attack vectors.
Developers introduce new features to their generative AI product in an effort to stand out from the competition and offer more value to customers.
Which of the following most accurately explains the risks when enabling more functionality?
Basic Concept: The relationship between AI system capabilities and security risk is a fundamental concept in AI governance. As AI models gain more functionality and capabilities, their potential for misuse, unintended consequences, and attack surface expansion grows proportionally. CompTIA SecAI+ Study Guide addresses capability-risk proportionality under AI governance.
Why D is Correct: The risks of a generative AI product are proportional to its capabilities. Each new feature expands what the model can do, which simultaneously expands what adversaries can manipulate it to do, what sensitive operations it can be directed to perform, and what unintended harm it can cause. A model that can generate text, images, execute code, and call external APIs has dramatically greater risk potential than one that can only generate text. Risk grows with capability scope.
Why A is Wrong: Risks do not remain constant when new features are added. New features introduce new attack vectors, expand the model's action space, and create new opportunities for misuse. Each addition fundamentally changes the system's risk profile.
Why B is Wrong: While risks do increase with new features, saying they simply increase does not capture the precise relationship. The increase is proportional to the nature and scope of the capabilities added, not a uniform increment for any feature addition.
Why C is Wrong: While risks can be measured qualitatively, stating that risks are measured qualitatively is a statement about measurement methodology rather than an explanation of how risks change when functionality is enabled. It does not accurately describe the relationship between capability and risk.
Faculty members at a university are concerned about potential inherent bias and inconsistency in one department's AI plagiarism detection service.
Which of the following principles will most likely address their concerns?
Basic Concept: Responsible AI principles each address different aspects of trustworthy AI behavior. When stakeholders are concerned about both bias and inconsistency --- specifically that the same or equivalent work might receive different treatment from the AI system --- the principle of consistency is most directly relevant. CompTIA SecAI+ covers responsible AI principles under governance.
Why C is Correct: Consistency in AI systems means the model applies the same rules, standards, and decision criteria uniformly across all inputs and user groups without variation based on characteristics unrelated to the task. An AI plagiarism detection system that produces inconsistent results across different student submissions or demographic groups fails the consistency principle, which directly addresses both the bias concern (differential treatment) and inconsistency concern the faculty have raised.
Why A is Wrong: Transparency relates to openness about how the AI system works and what data it uses. While valuable for understanding the system, transparency alone does not ensure that the system applies its rules uniformly or consistently.
Why B is Wrong: Explainability means the system can articulate why it made a particular decision. While useful for understanding individual cases, it does not guarantee that decisions are made with equal consistency across different submissions or groups.
Why D is Wrong: Accountability identifies who is responsible for AI system decisions and outcomes. It is a governance principle about ownership and responsibility rather than about ensuring uniform application of evaluation criteria.
A customer-facing, AI-powered chatbot has been jailbroken through prompt injections. As a result, the AI model is offering a 99% discount on the purchase of a new vehicle.
Which of the following should be implemented to enhance the model's robustness against such attacks?
Basic Concept: Jailbreaking through prompt injection exploits the LLM's tendency to follow instructions embedded in user input, overriding its intended behavior. The model was manipulated to offer unauthorized discounts, demonstrating that its operational boundaries were not properly enforced. CompTIA SecAI+ Study Guide identifies guardrails as the primary defense against jailbreaking attacks.
Why D is Correct: Guardrails are robust, layered controls that enforce behavioral boundaries on LLM inputs and outputs. They can detect and block jailbreaking attempts, enforce business logic constraints such as preventing unauthorized discounts, validate outputs against policy rules before delivery, and prevent the model from operating outside its defined scope. Guardrails are specifically designed to make models more robust against prompt injection and jailbreaking.
Why A is Wrong: Bias filtering is designed to detect and remove biased, discriminatory, or offensive content from model outputs. It addresses content fairness issues but does not prevent jailbreaking attacks that manipulate the model into performing unauthorized actions.
Why B is Wrong: A system prompt sets the model's base instructions and persona, but the jailbreak attack already demonstrates that the current prompt can be overridden. Guardrails provide enforcement at a layer that is more resistant to prompt manipulation than the system prompt alone.
Why C is Wrong: Log monitoring detects jailbreaking attempts after they have already succeeded. It is a detective control that enables incident response but does not prevent the model from offering unauthorized discounts in the first place.
An internal user enters a client credit card number into an internal generative machine learning (ML) model:
#User prompt: Customer Jane Doe has a new credit card that she wants to add to her account. The number is 5555-5555-5555-5555
Which of the following is the most effective way to prevent prompt injection attacks against a large language model (LLM)?
Basic Concept: Prompt injection occurs when malicious content embedded in user input manipulates an LLM's behavior, causing it to leak sensitive data, bypass restrictions, or execute unintended actions. Preventing such attacks requires mechanisms that inspect and filter content at the prompt level. CompTIA SecAI+ covers LLM-specific security controls extensively.
Why A is Correct: Guardrails are purpose-built controls that inspect, filter, and constrain both input prompts and output responses in LLM systems. They can detect sensitive data patterns such as credit card numbers, block prompt injection payloads, enforce content policies, and prevent the model from processing or outputting restricted information. Guardrails are the primary LLM-native defense against prompt injection as cited in the CompTIA SecAI+ Study Guide.
Why B is Wrong: Antivirus software detects known malware signatures in files and executables. It does not inspect or understand the semantic content of LLM prompts and cannot detect or block prompt injection attacks.
Why C is Wrong: A WAF operates at the HTTP layer inspecting web requests and responses against rule sets. While it can block some patterns, it lacks the contextual intelligence to understand LLM prompt semantics and cannot prevent sophisticated injection attacks.
Why D is Wrong: Role-based access control manages who can access which resources. It controls authorization but does not inspect the content of prompts to prevent injection attacks once a user has legitimate access.
Anjali Reddy
11 days agoIbrahim Sheikh
23 days agoSalman Aziz
1 month agoAndrew Mitchell
2 months agoTanvi Shukla
2 months agoSakura Yoshida
3 months agoRupali Saxena
3 months agoAmira Malik
4 months agoLaura Walker
4 months ago