Topics in this domain

Control Design versus Operating Effectiveness

Control testing · 1 min read

Two questions

Design effectiveness: could it work? Operating effectiveness: did it work all period?

Design first

If an access review excludes administrator accounts, it can’t control privileged access however diligently it’s performed. Finding that design gap first saves time and points straight to the fix.

Evidence for each

QuestionTypical evidence
DesignWalkthrough, design documents, one example traced
OperationSamples across the period, logs, sign-offs

Example. A change control was well designed: every change needed CAB approval. Sampling 40 changes found 9 deployed before approval during month-end. Design effective; operation not.

How the exam asks about it

If the question asks…The answer is usually…
Test FIRSTDesign effectiveness
Control can’t meet its objectiveDesign deficiency
Control not performed consistentlyOperating deficiency
Evidence for operating effectivenessSamples across the period

In short

  • Design effectiveness asks whether the control, if performed as designed, would achieve its objective.
  • Operating effectiveness asks whether it was performed consistently, as designed, throughout the period.
  • Test design first; if the design is flawed, testing operation is wasted effort.
  • Design is often confirmed with a walkthrough; operation needs samples across the period.
  • Both must be effective for the control to reduce risk as expected.

Exam traps

  • Testing operation of a control whose design can't achieve its objective.
  • Concluding a control operated all year from one walkthrough.
  • Assuming a well-documented control operates.
  • Ignoring changes to a control during the period.

Slides

Click the slide and use the arrow keys. F toggles full screen.

CRISC · Domain 3 · Control testing

Control Design versus Operating Effectiveness

The two questions every control test answers (could it work, and did it work throughout the period?) and why design is tested first.

1 / 7