Topics in this domain

Security Testing: Scanning, Pen Testing and Tracking Remediation

Controls · 2 min read

Prove it, don’t assume it

Controls that look good on paper can fail in practice. Security testing gives evidence of how the organisation would fare against a real attacker, and it’s a key input to control testing and evaluation in Domain 3. The security manager plans a program of tests that matches the risk, gets them authorised, and makes sure findings are fixed.

Types of testing

Vulnerability scanning, configuration review, penetration test and red team from broad to deep.
TestWhat it doesFrequency
Vulnerability scanningAutomatically finds known weaknessesWeekly to continuous
Configuration reviewCompares settings with baselinesContinuous or periodic
Penetration testExperts exploit weaknesses to show real impactYearly for critical systems and after major change
Red teamSimulates a real attacker over weeks; also tests detection and responsePeriodically, for mature programs

Scanning vs penetration testing

Vulnerability scan finds known weaknesses; penetration test exploits them to show impact.

A scan finds known weaknesses; a penetration test proves which of them matter by chaining and exploiting them. A clean scan only means no known issues were found by that scan.

Authorisation and planning

  • Written authorisation from the management that owns the systems. No signature, no test: unauthorised testing can be illegal and can disrupt operations.
  • Scope: which systems are in and out, and permission from third parties such as cloud providers.
  • Rules of engagement: timing, allowed techniques, stop conditions and emergency contacts.
  • Risk-based frequency: critical applications tested yearly and after major change; scanning runs continuously.

Fixing what’s found

Findings, plan, fix, verify, report.

Testers report findings; they don’t fix them during the test. The organisation then:

  1. rates each finding by risk and assigns an owner
  2. agrees a plan (fix, compensate or accept) and a due date
  3. fixes it through change management
  4. verifies it by retesting
  5. reports overdue items and trends to management

Example. An annual pen test finds the same weak admin passwords three years running. The security manager stops treating findings as a report to file: each one now becomes a risk register item with an owner and a due date, and is retested within 30 days.

How the exam asks about it

If the question asks…The answer is usually…
Most important requirement before a pen testWritten management authorisation and an agreed scope
Test that also checks detection and responseA red team exercise
How to decide testing frequencyBy risk, and after significant change
How to confirm a finding is fixedRetest and verify
Main purpose of security testingEvidence of control effectiveness

In short

  • A testing program combines vulnerability scanning (breadth), configuration review, penetration testing (depth) and red teaming (realism).
  • Penetration testing exploits weaknesses to show real impact; red teaming also tests detection and response.
  • Every test needs written authorisation from management with scope and rules of engagement.
  • Testing is risk-based: higher-risk systems are tested more often and more deeply, and after major change.
  • Findings are tracked like risks: owner, plan, due date, retest to verify.
  • Test results feed control evaluation, metrics, the risk register and the roadmap.

Exam traps

  • Testing without written authorisation can be illegal and disruptive.
  • A clean scan doesn't mean the system is secure.
  • Findings closed without retesting may not be fixed.
  • Testers shouldn't fix what they find during the test; they report it.

Slides

Click the slide and use the arrow keys. F toggles full screen.

CISM · Domain 3 · Controls

Security Testing: Scanning, Pen Testing and Tracking Remediation

How the security manager plans a security testing program (scans, reviews, penetration tests, red teams), authorises tests properly, and makes sure findings get fixed.

1 / 9