Performance Evaluation and Metrics

Performance Evaluation and Metrics - Performance Evaluation...

Info iconThis preview shows pages 1–8. Sign up to view the full content.

View Full Document Right Arrow Icon
Performance Evaluation and Metrics Prepared by: Jerry Gao Date: 9/14/00 Copyright 2000 by Jerry Gao
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Presentation Outline Introduction Performance Testing, Process, and Tools Performance Evaluation and Models Performance Evaluation and Metrics Performance Evaluation Models: Event-Based Function Scenario Model for System Performance Evaluation Event-Based Transition Model for System Performance Evaluation Performance Metrics Performance, throughput, availability, reliability, scalability, and utilization Supporting Environment Copyright by Jerry Gao
Background image of page 2
Performance Testing Performance testing – refers to test activities on checking system performance The major objectives of performance testing: To confirm and validate the specified system performance requirements. To check the current product capacity to answer the questions from customers and marketing people. To identify performance issues and performance degradation in a given system Copyright by Jerry Gao
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Performance Testing - Focuses System process speed (Max./Min./Average) o system processes, tasks, transactions, responses. o data retrieval, data loading System throughput (Max./Min./Average) o loads, messages, tasks, processes System latency (Max./Min./Average) o Message/event, task/process System utilization (Max./Min./Average) o Network, server/client machines. System availability (component-level/system-level) o component/system, services/functions o system network, computer hardware/software Copyright by Jerry Gao
Background image of page 4
Performance Testing - Focuses System reliability (component-level/system-level) o component/system, services/functions o system network, computer hardware/software System scalability (component-level/system-level) o load/speed/throughput boundary o improvements on process speed, throughput System successes/failures rates for o communications, transactions, connections o call processing, recovery, … Domain-specific/application-specific o agent performance o real-time report generation speed o workflow performance Copyright by Jerry Gao
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Performance Testing - Test Process Understand system and identify performance requirements Identify performance test objectives and focuses Define performance test strategy: o Define/select performance evaluation models o Define/select performance test criteria o Define and identify performance test metrics. Identify the needs of performance test tools and define performance test environment Write performance test plan Develop performance test tools and support environment Set up the target system and performance test beds Design performance test cases and test suite Performance test execution and data collection Performance analysis and reporting Copyright by Jerry Gao
Background image of page 6
Performance Test - Tools Performance test tools can be classified into: Simulators and data generators: o Message-based or table-based simulators o State-based simulators
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 8
This is the end of the preview. Sign up to access the rest of the document.

This document was uploaded on 01/31/2010.

Page1 / 70

Performance Evaluation and Metrics - Performance Evaluation...

This preview shows document pages 1 - 8. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online