Table of Contents
Introduction xi
Rex Black xv
Leo van der Aalst xvii
James L. Rommens xix
Rex Black's Acknowledgements xxi
Leo van der Aalst's Acknowledgements xxiii
James L. Rommens' Acknowledgements xxv
1 Test Missions, Policies, Strategies, and Goals 1
1.1 Introduction 1
1.2 Mission, Policy, and Metrics of Success 2
1.2.1 Identifying Stakeholders 3
1.2.2 Understanding the Mission and Objectives 4
1.2.3 Measuring Achievement 7
1.2.4 Selling and Meeting Goals 11
1.3 Test Strategies 14
1.3.1 The Contents of the Test Strategy 14
1.3.2 Analytical Strategies 18
1.3.3 Model-Based Strategies 21
1.3.4 Methodical Strategies 23
1.3.5 Process- or Standard-Compliant Strategies 25
1.3.6 Reactive Strategies 27
1.3.7 Consultative Strategies 29
1.3.8 Regression-Averse and Test Automation Strategies 30
1.3.9 Developing a Workable Test Strategy 32
1.4 Alignment of Test Policy and Test Strategy with the Organization 34
1.4.1 Practical, Complete, and Consistent Test Policies and Strategies 34
1.4.2 Successful Test Policies and Test Strategies 36
1.4.3 Achieving Alignment 37
1.5 Sample Exam Questions 39
2 Managing the Test Team 43
2.1 Introduction 43
2.2 Building the Test Team 44
2.2.1 Job Descriptions 46
2.2.2 Résumés 48
2.2.3 Interviewing 49
2.2.4 Selecting the People to Hire 56
2.2.5 Bringing People Into the Team 57
2.2.6 Termination of Employment 59
2.2.7 Ending Contractual Relationships 61
2.3 Developing the Test Team 63
2.3.1 Developing Individuals 64
2.3.2 Setting Goals and Objectives 66
2.3.3 Denning Clear Roles and Responsibilities 70
2.3.4 Individual Personalities and Roles Within Teams 76
2.3.5 Skills Development, Training Opportunities, and Mentoring 80
2.3.6 Performance Reviews and Feedback 83
2.4 Leading the Test Team 84
2.4.1 Information Sharing and Communication 85
2.4.2 Fostering Loyalty and Trust 89
2.4.3 Team Building 90
2.4.4 Motivating and Challenging the Test Team 93
2.4.5 Managing Distributed Teams 95
2.5 Sample Exam Questions 97
3 Managing External Relationships 105
3.1 Introduction 105
3.2 Types of External Relationships 106
3.3 Contractual Issues 108
3.4 Communication Strategies 111
3.4.1 Dimensions of Information Strategies 111
3.4.2 Communication Tools 114
3.4.3 Other Communication Considerations 115
3.5 Integrating from External Sources 117
3.6 Merging Test Strategies 119
3.7 Verifying Quality 123
3.8 Sample Exam Questions 127
4 Managing Across the Organization 131
4.1 Introduction 131
4.2 Types of External Relationships 132
4.2.1 Promoting and Advocating the Test Organization 133
4.2.2 Selling the Value of Testing 137
4.2.3 Creating a Defensible Team 143
4.2.4 Protecting and Supporting the Team 147
4.3 Placement of the Test Team 158
4.3.1 Independence and Reporting Structure 158
4.3.2 Access to Information 160
4.3.3 Skills 161
4.4 Stakeholder Communication 163
4.5 Creating and Building Relationships 167
4.5.1 Random Relationships 168
4.5.2 Who You (Should) Know 172
4.5.3 A Real Social Network 176
4.6 Advocating Quality Activities Across the Organization 177
4.7 Integrating Tools Across the Organization 181
4.7.1 Purchasing, Selecting, and Acquiring the Multiuse Tool 182
4.7.2 Updating, Maintaining, and Supporting the Multiuse Tool 183
4.7.3 Converting and Retiring Tools 184
4.7.4 The Manager Role with Multiuse Tools 185
4.8 Handling Ethical Issues 186
4.8.1 Managing the Team's Ethics 187
4.8.2 Interacting with Test Stakeholders and Reporting Test Results 188
4.8.3 Test Management Ethics 189
4.9 Sample Exam Questions 192
5 Project Management Essentials 199
5.1 Introduction 199
5.2 Project Management Tasks 201
5.2.1 Test Estimation 202
5.2.2 Denning the Testing Schedule 209
5.2.3 Budgeting and Resource Allocation 211
5.2.4 Managing and Tracking a Project 214
5.2.5 Dealing with Trade-Offs 217
5.2.6 Change Management 220
5.2.7 Time Management 221
5.3 Project Risk Management 223
5.3.1 Managing Project Risks 226
5.3.2 Participating in Project-wide Risk Management 232
5.4 Quality Management and Testing 235
5.5 Sample Exam Questions 239
6 Test Project Evaluation and Reporting 245
6.1 Introduction 245
6.2 Tracking Information 246
6.2.1 Burn Baby Bum 251
6.3 Evaluating and Using Information - Internal Reporting 253
6.3.1 The earlier the better 255
6.4 Sharing Information - External Reporting 260
6.4.1 Kanban Boards 264
6.5 Test Results Reporting and Interpretation 267
6.6 Statistical Quality Control Techniques 278
6.7 Sample Exam Questions 281
7 Testing Considerations for Domain and Project Factors 285
7.1 Introduction 285
7.2 Test Management Considerations for Lifecycle Models 286
7.2.1 Comparison of Lifecycle Models 287
7.2.2 Waterfall and Agile Models 287
7.2.3 Testing Concepts in Agile Approaches 294
7.2.4 Changed Role of Test Manager in Agile Approaches 296
7.3 Managing Partial Lifecycle Projects 297
7.3.1 Integration Projects 297
7.3.2 Maintenance Projects 301
7.3.3 Hardware/Software and Embedded Systems Projects 305
7.3.4 Safety-critical Systems Projects 309
7.4 Release Advice and Considerations 313
7.4.1 Release Advice 313
7.4.2 Release Considerations 314
7.5 Sample Exam Questions 317
8 Evaluating Effectiveness and Efficiency 321
8.1 Introduction 321
8.2 Effectiveness, Efficiency, and Satisfaction Metrics for the Test Process 322
8.3 Effectiveness, Efficiency, and Satisfaction Metrics for the Test Policy Objectives 330
8.4 Project Retrospectives 333
8.5 Sample Exam Questions 337
Appendix A The Expert Test Manager Exams 339
Appendix B Answers and Explanations for Chapter Sample Questions 345
Index 371