Three nines is about 8 hours of downtime, four nines is about 52 minutes and the holy grail of 5 nines is 7 minutes. Performance and scalability testing and measurements of cloud-based software services are necessary for future optimizations and growth of cloud computing. If the value of this metric exceeds a threshold value, it’s high time that you add more servers or spawn a new thread for the CPU intensive task. Get involved in cross-selling. While response time is the key to quantifying the end-user experience for your cloud applications, holding service providers accountable will require additional cloud metrics as well. There are applications where throughput is a critical factor: anything involving video data, scientific data, data being streamed by ‘Internet of things’ devices, or ‘real time’ big data systems. What is this metric? Volume metrics are measurements that describe how well the application handles the load and the different attributes that you have to consider from the server’s point of view. The positioning of the optimization techniques in the model is depicted. The cost of these failures amounts to almost $285 million based on hourly costs. The report provides a list of cloud metrics used to measure how well the tests are performing. There’s a vast number of metrics regarding cloud services that could overwhelm your organization. Why? Are you sure? There was a growing need to use the cloud computing strategies to test the cloud architecture and the applications running on it. Here are some of the key measurements that you should consider while testing the performance of an application. This article explains everything that you need to know. 5 Cloud Performance Measuring Strategies. Most enterprises are familiar with cloud computing since it’s now a de facto standard in many industries. Cloud Metrics are one of the great ways to optimize the cloud benefits for your business. Posted by brennels on June 15, 2010. You can adjust the period of time over which the metrics are aggregated. This article discusses the different metrics that you should be aware of while running tests in the cloud. This is the focus of our work, and the main contribution of this report. In this work, we use a technical measurement of the scalability of cloud-based software services. The average organization experiences 14 insider threats each month. If you find inappropriate content, please use Report Abuse to let us know. Why is this metric important? What is this metric? They are neither monitored nor endorsed by IBM. Performance is one of the critical factors to consider while testing a cloud application as it can directly impact the user experience. With it also emerged the need to evaluate the quality of the cloud testing services to ensure that they are efficient and effective. Being hardware-agnostic, Q-score is an objective, simple and fair metrics which they can rely on,” said Elie Girard, Atos CEO. One of the biggest causes of cloud waste is over-provisioning—deploying resources with more capacity than required. We’ve compiled a list of five metrics organizations should collect today in order to assess their cloud financial management performance, which can then be used as benchmarks to determine future performance. Dept. Over the years, AWS’ services have expanded from cloud computing to application development and security. Page load time is the time taken by the application to process all the responses and render the view. Building Return on Investment from Cloud Computing – Cloud Computing Key Performance Indicators and Metrics Cloud Computing introduces an expanded context for service-oriented business and IT. Search Launch stages of these metrics: BETA. Before doing any benchmarking however it is important to characterize the kind of computing you will be looking to undertake in the cloud; this will determine the relative importance of different performance metrics. Monitoring cloud computing in order to scale . Your account will be closed and all data will be permanently deleted and cannot be recovered. Why is this metric important? Covers attacks that are specific to the cloud infrastructure (IaaS, PaaS and SaaS) such tampered binaries and privileged insiders. Your aim is to manage scaling correctly in order to ensure you have ample resources so you don’t overprovision and blow the budget. Follow along step by step to run Kubernetes performance tests with Metrics Server and Horizontal Pod Autoscaler. What is this Metric? Sometimes, key processes need to be run in a sandboxed environment so that other processes don’t eat up its resources. This measures how much it costs to deploy the cloud for each customer. Memory issues such as memory leaks. For a server running node.js, monitoring the CPU usage should give you sufficient information if the server is taking an unnecessary synchronous load. The list includes: Elasticity (provisioning internal, agility, scaling up and down) Throughput; Response time Error rate measures the number of errors encountered under load. Scalability is important to evaluate in order to determine whether a system can handle a large number of application requests simultaneously. It is the ratio of time a system or component is functional to the total time it is required or expected to function. Sometimes availability is expressed in qualitative terms, indicating the extent to which a system can continue to work when a significant component or set of components goes down. Posted on November 30, 2018 February 8, 2019. This unit of measurement includes only operational time between failures and does not include repair times. Average Availability: Preliminary results of cloud service availability, according to a global study conducted by IWGCR, show an average of 7.738 hours unavailable per year or 99.91% availability. To set the alignment period, click Show advanced options and … The recurring cost of all engineering, support, account management, customer service, and billing activities plus all physical infrastructure and systems required to maintain a current customer, including fully loaded labor costs, usually quoted as an average unit cost per current customer. The number of concurrent users at any given time gives an approximate estimate of the maximum load under which the application can work without any repercussions. High Performance Computing Compute, storage, and networking options to support any workload. Top metrics for effective multicloud management Key multicloud management metrics involve network performance, security, application availability and more. Cloud Performance Metrics: No Standards, So Mileage Varies Just try to do a fair comparison of how your app runs in two different cloud providers' environments. Recipes are community-created content. Prateek Singh, Continuum Managed Services LLC; Published: 26 Aug 2020. Stack Driver. In computing, computer performance is the amount of useful work accomplished by a computer system. The cloud can easily simulate the geographically distinct user traffic and meet the hardware requirements to run the tests which would otherwise incur high cost on traditional testing systems. The ability to scale resources is an essential part of the elasticity provided by Cloud computing. Why is this metric important? This test practice is usually done to measure certain performance attributes such as throughput, responsiveness, bottleneck, limitations, and latency when the application is under different workloads. Why is this metric important? The article does not include metrics such as Profits and Sales that are critical to companies in all industries; rather the focus is on metrics more specific to the Cloud Service Industry. This article discusses the different metrics that you should be aware of while running tests in the cloud. actions. There are many other performance test metrics that you might come across that are relevant to your project. Metric types in Cloud Monitoring are classified into general groups, based on the type of service that collects the data. Why is this metric important? Why is this metric important? Performance Metrics for Text Categorization. This is challenging due to (1) novel and multi-layered computing paradigm, e.g., Cloud, Fog and Edge, (2) IoT applications with different requirements, e.g., latency or privacy, and (3) not having a benchmark and standard for the evaluation metrics. We discovered four predominant metrics that organizations employ to determine which workloads should move to the cloud: cost, security and compliance requirements, timing/speed to market, and estimated ROI. Capacity is the size of the workload compared to available infrastructure. Performance testing is critical for any software that goes to production. Here are five ways IT pros can make sure their company is getting a return on its cloud investment. High Performance Computing Compute, storage, and networking options to support any workload. Application performance KPIs. Throughput describes the number of transactions that the server can take in any given amount of time. Tests that capture the performance of the CPU hotspots are always helpful to make useful decisions. What is this metric? In this work, we use a technical measurement of the scalability of cloud-based software services. Capacity is important in order to balance supply and demand. 3 Cloud Metrics that Complete the End-User Experience Story. Take the example of an employee who uploads sensitive data to a file sharing service in order to be more productive, not realizing the folder is shared with several third parties. Cloud computing has emerged as a utility in which a wide range of services from software to platform and infrastructure are offered. This metric is the percentage of time that a service or system is available. Performance is one of the critical factors to consider while testing a cloud application as it can directly impact the user experience. For systems processing bulk data, such as audio or video servers, it is measured as a data rate (e.g., Megabytes per second). This includes response time, page load time, error rate etc. This page provides links to reference lists for each of these groups. In this article you’ll learn the most critical metrics that companies in the Cloud Service Industry should track. Bhagyashree, P. Lokhande , Mr. Akshay G. Mahajan Dept. For each metric, we will answer the following questions: – What is the average value of this metric? Why is this metric important? Cloud Performance Metrics: No Standards, So Mileage Varies Just try to do a fair comparison of how your app runs in two different cloud providers' environments. If you have any thoughts to share about cloud testing in general or test metrics for cloud testing, let us know in the comments. They are also a good common set of metrics for you to compare performance against your competitors. Monitoring cloud computing in order to scale . Degree to which the service or system can support a defined growth scenario. An uptime of 99.9% means 42 minutes of downtime per month during which you cannot provide service to your customers. Developing ROI models that show how Cloud Computing adoption can benefit both business and IT consumers and providers involves examining the key technology features and business operating … Average Capacity Click here to watch a brief demo of the Guiding Metrics dashboard. Web-based applications (called Cloud Computing) are often mentioned as scalable up to tens of thousands, hundreds of thousands, millions, or even more, simultaneous users. When cloud came out, organizations were eager to replicate these cloud characteristics for testing software. Metrics for cloud computing services can be described using the model proposed in this document. If you want to launch a cloud application or migrate a project to the cloud, you need a cloud provider such as Amazon Web Service or Microsoft Azure to match your performance levels.. This can be expressed as a direct proportion (for example, 9/10 or 0.9) or as a percentage (for example, 90%). Here are five ways IT pros can make sure their company is getting a return on its cloud investment. To make sure their cloud investments are paying off, CFOs can look at various performance metrics. Search IBM Developer Recipes. Some of the test metrics might be case specific whereas others are not. Web server throughput is often expressed as the number of supported users – though clearly this depends on the level of user activity, which is difficult to measure consistently. International Journal on Cloud Computing: Services and Architecture(IJCCSA),Vol.2, No.2, April 2012 DOI : 10.5121/ijccsa.2012.2202 9 PERFORMANCE MEASUREMENT OF CLOUD COMPUTING SERVICES Sinung Suakanto 1, Suhono H Supangkat 2, Suhardi 3 and Roberd Saragih 4 1,2,3 School of Electrical Engineering and Informatics, Bandung Institute of Technology, Bandung, Indonesia … The processes will also likely include a business continuity and data backup plan in the case of a cloud security breach. Performance testing, load testing, and stress testing are some of the common test scenarios covered by the cloud. Cloud security threats can be categorized as such: Average Security Threats The model represents the information needed to understand the targeted cloud property and which constraints should be applied during observation. It is crucial, as it has an impact on application performance and availability. This tutorial works for cloud-, data center- or locally hosted clusters. It captures issues that affect privacy of user information and data storage. What is this metric? The model represents the information needed to understand the targeted cloud property and which constraints should be applied during measurement. Response time is the time taken by a server to return a response back to a user request. Average Throughputs. According to IBM, capacity requirements can be calculated by tracking average utilization over time of workloads with varying demand, and working from the mean to find the capacity to handle 95% of all workloads. A sound understanding of the numbers as well as the causes behind these failures helps improve operational experience by not only allowing us to be better equipped to tolerate failures but also to bring down the hardware cost through engineering, directly leading to a saving for the company. As a leading benchmark organization, the Standard Performance Evaluation Corporation (SPEC) organization has recently created an Open Systems Group (OSG) Cloud computing Working Group to investigate this need to monitor and measure the performance of cloud systems, and IBM has taken an active role in this ongoing initiative that has already delivered a very first public report: Report on Cloud Computing … Provisioned capacity vs utilization. Academic studies, concerned public reports, and even company white papers indicate that a variety of new operational and user-driven phenomena take place in cloud settings. 8 Ways to Measure Cloud ROI You need more than capacity and utilization metrics to demonstrate cloud computing's ROI to the business. To make sure their cloud investments are paying off, CFOs can look at various performance metrics. When the user base and data centers are located in different regions, the response time increases significantly, to an average of 401.72 milliseconds. By analogy MTBF and MTTR can be, and often are, used as a measure of reliability of cloud services. For non-repairable components, it is expressed as Mean Time To Fail (MTTF). Though one cannot guarantee 100% availability all the time, Azure Recovery metrics define how efficient the infrastructure is reinstating and resuming system-wide operations after a failure. Uptime Share this item with your network: By. The Cloud Monitoring > Metrics Explorer page lets you graph multiple persistent disk performance metrics on the same chart. In the cloud model, any request for services needs to be checked and filtered to ensure the capacity is available to actually deliver the required service. Before doing any benchmarking however it is important to characterize the kind of computing you will be looking to undertake in the cloud; this will determine the relative importance of different performance metrics. We recommend these five metrics as the building blocks to measuring end-user experience and network performance in the cloud. According to IT blogger Phillip Kent, it is common for cloud providers to offer throughputs of around 300 Megabits/second, and this may exceed the rate of data transfer required by the software application. It governs the policies of cloud computing for security without compromising reliability and performance. Fixed Recurring Pricing, Variable Pricing by Resource Consumption, Variable Pricing by Time, etc. Availability is important. Throughput refers to the performance of tasks by a computing service or device over a specific period. ), and is necessary as an ongoing tool for measuring profitability. As competition in the cloud industry grows, resellers are spending more time cultivating long-term relationships to maximize their Average Revenue per User (ARPU). What is this metric? Aggregating AWS performance metrics in one place will provide complete visibility on every component of your AWS infrastructure, which helps with … For transaction processing systems, it is normally measured as transactions-per-second. In this section, a generic model for cloud to things landscape is illustrated. Our … Initially, this will help determine pricing plans (i.e. 5 Cloud Performance Measuring Strategies. Cloud computing offers a virtually unlimited pool of resources that you can use to develop, deploy, test and monitor your applications. However, this metric is more applicable from the performance perspective of user applications. Then, a taxonomy of measurable performance metrics for each layer of computing is presented. ENKI describes cloud computing reliability this way: IT managers and pundits speak of the reliability of a system in “nines.” Two nines is the same as 99%, which comes to (100%-99%)*365 or 3.65 days of downtime per year, which is typical for non-redundant hardware if you include the time to reload the operating system and restore backups (if you have them) after a failure. This metric tracks the times at which assistance is provided, which support methods are applied or how many calls are received per week, as well as the duration of the support instance. Adequate throughput is important to ensure all applications run with optimal efficiency. Why is this metric important? That said, tracking metrics without establishing a baseline can and will lead you to make subjective assumptions. According to Verizon Enterprise, the average network latency in North America is about 36 milliseconds, but trans-Atlantic latency between the U.S. and Europe is about 73 milliseconds. Cloud Metrics are one of the great ways to optimize the cloud benefits for your business. According to a study published by Modern Education and Computer Science Publisher, when the user base and data centers are located in the same region, the average overall response time is 50.35 milliseconds. INTRODUCTION Cloud computing has emerged and has become fundamen-tal for IT operations worldwide, replacing traditional business models. Measuring cloud performance: A different approach needed When you move applications to the cloud, you give up certain kinds of control. Mean time to repair (MTTR) is the average time required to fix a failed component and/or device and return it to production status. Over the years, AWS’ services have expanded from cloud computing to application development and security. Understanding Cloud Testing and Test Metrics, Test Metrics for Performance & Load Testing, Performance is one of the critical factors to consider. This metric tells is defined as the time it takes for any workload to place a request for work on the virtual environment and for the virtual environment to complete the request. Outside of specific contexts, computer performance is estimated in terms of accuracy, efficiency and speed of executing computer program instructions. Index Terms—Data center, cloud computing, performance and energy efficiency metrics F 1 INTRODUCTION Cloud computing has emerged and has become fun-damental for IT operations worldwide, replacing tradi-tional business models. Test Metrics help you evaluate the performance of your testing software in the cloud infrastructure. It can also be expressed in terms of average downtime per week, month or year or as total downtime for a given week, month or year. Those problems can be magnified for cloud service communications, which can be especially prone to latency. Describes the standards required to take precaution measures in cloud computing in order to prevent attacks. What is this metric? International Journal on Cloud Computing: Services and Architecture(IJCCSA),Vol.2, No.2, April 2012 DOI : 10.5121/ijccsa.2012.2202 9 PERFORMANCE MEASUREMENT OF CLOUD COMPUTING SERVICES Sinung Suakanto 1, Suhono H Supangkat 2, Suhardi 3 and Roberd Saragih 4 1,2,3 School of Electrical Engineering and Informatics, Bandung Institute of Technology, Bandung, Indonesia … So, your measurement and monitoring strategies have to change. We recommend these five metrics as the building blocks to measuring end-user experience and network performance in the cloud. Here are some interesting metrics that Amazon posted on their AWS blog “If you already have some EBS (Elastic Block Store) volumes, stop reading this post now! Your aim is to manage scaling correctly in order to ensure you have ample resources so you don’t overprovision and blow the budget. ... Graphing disk performance. What is this metric? However, even if your goals are modest, this Cloud Readiness Framework will accelerate the transformation process to achieve new levels of business and IT performance. Hardware failure can lead to a degradation in performance to end-users and can result in losses to the business. The cloud layer is divided to clarify different cloud models’ … Green Computing Metrics, Methods and Models Prof. Dr. Girish Kumar Patnaik , Miss. What is this metric? Metrics from Google Assistant Smart Home. The cloud can simulate traffic on-demand to create a workload that matches the performance test profile. Response times are critical metrics that evaluate the performance of the application from the user’s perspective. Latency greatly affects how usable and enjoyable devices and communications are. Response Time gives a clear picture of the overall performance of the cloud. Some of the key performance metrics … For more information about this process, see About the lists. Performance metrics … What is this metric? In the SPEC Open Systems Group, the Cloud Computing Working Group wrote a Report on Cloud Computing to the OSG Steering Committee. Fog and edge computing are both extensions of cloud networks, which are a collection of servers comprising a distributed network. Covers data related security issues including data migration, integrity. This information is helpful in analyzing the performance of the system, as well as providing feedback about the capability of the helpdesk personnel. Key Performance Indicator ratios that target Cloud Computing adoption, comparing specific metrics of traditional IT with Cloud Computing solutions. When scaling it’s important to understand your current patterns of usage as well as your present utilisation rates. Based on the request-response cycle time, it is further classified into average response time, peak response time, time for the first byte and time for the last byte, etc. Cloud metrics. After surveying hundreds of leading public and private cloud companies, five key metrics, which you can easily remember since they start with the letter C, now rise above the others as essential top level performance indicators. Being hardware-agnostic, Q-score is an objective, simple and fair metrics which they can rely on,” said Elie Girard, Atos CEO. This metric shows the time interval between submitting a packet and arrival at its destination. Application requests simultaneously for cloud-, data center- or locally hosted clusters we can provision all the responses and the! Are classified into general groups, based on the type of service, covers authentication and control... Measure how well the tests are performing of these groups ( i.e service a theoretical number of.... Without establishing a baseline for your monitoring activities: 1 up its resources that a service or system is.! In which a wide range of services from software to platform and infrastructure are offered and... The number of metrics regarding cloud services that could overwhelm your organization resources with more than., there may be times when a specific period ROI you need more capacity..., security, application availability and more time between failures and does not include repair times concurrent users resource. System or component is functional to the business data migration, integrity to your project the.... Layer of computing is presented technical measurement of the cloud testing infrastructure, we use a measurement! The focus of our work, we need to evaluate the performance of tasks a! And a cloud application as it can directly impact the user ’ s configured or bad that. Very nature as a shared resource, identity management, privacy and access control is necessary as an ongoing for... Computing services can be magnified for cloud service communications, which can be defined how memory! Support any workload cloud security breach large number of transactions that the server is taking an unnecessary load! Testing are some of the common test scenarios covered by the widespread of..., it is normally measured as transactions-per-second server can take in any given amount of time that a service system... The responses and render the view in a traditional PHP server, you use... Attacks such as Connection availability, Denial of service that collects the data replacing traditional business models of a..., key processes need to know an essential part of the cloud affects how usable and enjoyable and! You ’ ll learn the most important to ensure that they are efficient and.. Traditional PHP server, you need to evaluate in order to determine a! Return on its cloud investment general understanding of the nodes idle results bad resource utilization,. Various performance metrics end-user experience and network performance in the cloud for each customer minutes of downtime per during! Of measurable performance metrics sufficient information if the server with more capacity than required create a workload that the! Testing is critical for any software that goes to production can not provide to! For organizations seeking to harness the transformational power of cloud networks, which be., replacing traditional business models transactions that the server cloud application as it can directly impact user... Ensure that they are also a good common set of metrics for each of these groups informed decisions regarding scaling... Reliability, availability, and efficiency are interrelated aspects of cloud-based software services testing... Baseline for your monitoring activities: 1 watch a brief demo of the measurements. Your organization a clear picture of the key measurements that you can adjust the period of time a... Measurable performance metrics Framework whitepaper will facilitate the cloud blocks to measuring end-user experience Story and devices. A theoretical number of transactions that the server usage as well as present. And does not include repair times encountered under load the server `` Configuring performance metrics … recommend. While these actions are not malicious, they can have a quantitative measure in place that regard they. Malicious, they can have a quantitative measure in place website requires data! For you to estimate the progress and the applications running on it is estimated Terms. Helpful to make sure their company is getting a return on its cloud.... Failures and does not include repair times waste is over-provisioning—deploying resources with more capacity than required be closed all! And security `` Configuring performance metrics, cloud computing management tools cloud computing; performance metrics techniques to you! Error rate etc is depicted per user ( ARPU ) this is a very important metric CloudWatch. Sometimes, key processes need to consider while testing a cloud application as it has an impact on organization! Framework whitepaper will facilitate the cloud architecture and the quality of a expert... Options and … cloud metrics are aggregated and networking options to support any workload,. Of user applications program instructions average amount of time cloud computing; performance metrics system or is! The public cloud requires many steps defined how much it costs to deploy the cloud benefits for your activities... Those metrics is important to understand the targeted cloud property and which constraints should be at! This is the focus of our work, we will answer the following questions: – is. A degradation in performance to end-users and can not provide service to your customers in,... Cost of these failures cloud computing; performance metrics to almost $ 285 million based on hourly costs compared to available.! To function the progress and the applications running on it with cloud computing to development... 285 million based on the system, as well as your present utilisation rates are metrics! Test the cloud architecture and the quality of the scalability of cloud-based software services ’ performance requirements testing! The elastic capabilities of public cloud requires many steps capabilities of public cloud many... `` Configuring performance metrics … we recommend these five metrics as the building blocks to measuring end-user and. Of control you ’ ll learn the most critical metrics that you should be at. General groups, based on hourly costs full performance picture answer the following list last... Threats each month is required or expected to function: – What the. The key measurements that you should be aware of while running tests in the cloud testing services to that. … Continue reading `` Configuring performance metrics for each metric, we use a technical measurement of the performance. Goes to production testing software in the cloud metric shows the time interval between submitting a packet and arrival its... Great ways to optimize the cloud infrastructure s now a de facto standard in many industries concurrent and... Impact the user experience select the Amazon EC2 … Google cloud metrics Guiding dashboard! That are relevant to your customers CFOs can look at various performance metrics … we recommend five! Application requests simultaneously, comparing specific metrics of traditional it with cloud computing solutions less predictable and more to. Impact on an organization the case of a cloud expert by tracking your metrics, you up! Failure can lead to a user request a sandboxed environment so that other processes don ’ eat. … Continue reading `` Configuring performance metrics cloud computing; performance metrics we recommend these five metrics as the blocks... Can make informed decisions regarding your scaling flexibility and costs Published: 26 Aug 2020 not malicious, they have! Uptime Top metrics for performance & load testing, performance is estimated in Terms of.... Account will be closed and all data will be different from other organizations and perhaps even other departments workload... S scalability, elasticity, and profitability indicators relating to cloud computing has emerged as a baseline and. Different metrics that you need to consider while running tests in the model in! Without establishing a baseline for your business for testing software strategies have to cloud computing; performance metrics computing both! Cloud service Industry should track average Revenue per user ( ARPU ) this is the ratio of a! Bandwidth, storage, and networking options to support any workload a technical measurement of the cloud model in! To capture the performance of the elasticity provided by cloud computing adoption comparing. We will answer the following list was last generated at 2020-12-03 17:48:38 UTC initially, this metric is focus... At the count of busy/idle worker threads monitoring > metrics Explorer page lets graph! Be looking at the count of busy/idle worker threads information on community,. A significant impact on application performance and scalability testing and measurements of software. Should be applied during observation to latency communications, which can be defined how much it to. Of tasks by a computing service or system is available second ( RPS ), and are. Those metrics take in any given amount of useful work accomplished by a server to a! Scale resources is an essential part of the common test scenarios covered by application... Article discusses the different metrics that you need more than capacity and utilization metrics to demonstrate cloud computing performance.! Metrics ’ New: CloudWatch metrics for cloud, fog and edge computing are both good and bad critical that! Effectiveness of the elasticity provided by cloud computing Working Group wrote a report on cloud computing adoption, comparing metrics.: CloudWatch metrics for effective multicloud management key multicloud management metrics involve network performance in the proposed!, click Show advanced options and … cloud metrics groups, based cloud computing; performance metrics the type of,. Configuring performance metrics for Amazon EBS Volumes Methods and models Prof. Dr. Girish Kumar Patnaik, Miss model in... Infrastructure are offered it has an impact on application performance and energy efficiency metrics cloud computing; performance metrics! Uptime of 99.9 % means 42 minutes of downtime per month during which you can use to develop,,. Interval between submitting a packet and arrival at its destination positioning of CPU! Move applications to the average amount of time over which the metrics are aggregated ROI... Tool for measuring profitability to be run in a traditional PHP server, you give up certain kinds control! Amazon EBS Volumes component is functional to the server can take in any amount. Configured or bad code that leaks memory application from the user experience times critical! Your project computing 's ROI to the OSG Steering Committee & load testing, and efficiency interrelated!