Performance Management of Enterprise Application Systems in the Cloud Era

云时代企业应用系统的性能管理

• 批准号: RGPIN-2018-04224
• 负责人: Krishnamurthy, Diwakar
• 金额: $ 4.95万
• 依托单位: University of Calgary
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=752157
• 关键词: Performance; Management; Enterprise; Application; Systems

Enterprise applications, e.g., Web and interactive big data services, need to respond quickly to user transactions. Consequently, system operators need techniques that ensure applications meet their response time objectives while utilizing computing resources in a cost-effective way. Several factors necessitate new performance management techniques for such systems. For example, these applications are being increasingly deployed on public cloud platforms, which can suffer from unpredictable performance degradations due to contention for shared cloud resources. Novel approaches are needed to manage system performance in the presence of such platform induced interference. Furthermore, these systems typically experience bursty workloads, which can degrade performance in complex ways. This motivates new techniques that can predict and mitigate the impact of burstiness. This program seeks to address such challenges. We will investigate new techniques that allow an operator to accurately predict the cloud resources needed by a system to satisfy a desired response time target while handling a given workload. Techniques based on queuing analysis typically require an expert to manually author a system model. Also, accuracy can be impacted when predicting for bursty workloads. Machine learning (ML) techniques promise a data-driven alternative to queuing analysis. However, existing work does not provide clear intuition on tasks that can have a big impact on accuracy such as ML technique selection, featurization, and training data selection. My program will address this knowledge gap and realize automated prediction techniques that do not burden an operator with such tasks. We will also explore runtime techniques to mitigate the impact of burstiness and interference. Existing work has not focused on handling the adverse impact of service demand burstiness, i.e., user transaction patterns that cause sustained periods of high or low utilizations at system resources. Our initial work suggests that such burstiness can be tamed using fewer resources by intelligently reordering incoming transactions. We will build on this insight to realize new runtime scheduling techniques. As part of this theme, we will also exploit our ongoing work on interference detection to automatically scale cloud resource instances , e.g., containers, in response to interference. Existing approaches do not consider how individual transaction types get impacted by interference at a given instance. We will build models that can use such fine-grained information to intelligently distribute transactions to instances such that interference is mitigated using minimum instances.This program will expand the state of the art in data-driven performance prediction and management research. Canadian organizations can exploit the research to reduce costs related to poor performance and resource over-provisioning.

企业应用程序，例如Web和交互式大数据服务，需要快速响应用户事务。因此，系统操作员需要确保应用程序满足其响应时间目标，同时以经济高效的方式利用计算资源的技术。有几个因素需要针对此类系统采用新的性能管理技术。例如，这些应用程序越来越多地部署在公共云平台上，由于共享云资源的争用，公共云平台可能会遭受不可预测的性能下降。在存在此类平台引起的干扰的情况下，需要新的方法来管理系统性能。此外，这些系统通常会经历突发性工作负载，这可能会以复杂的方式降低性能。这催生了可以预测和减轻突发性影响的新技术。该计划旨在解决此类挑战。我们将研究新技术，使操作员能够准确预测系统在处理给定工作负载时满足所需响应时间目标所需的云资源。基于排队分析的技术通常需要专家手动创建系统模型。此外，在预测突发工作负载时，准确性也会受到影响。机器学习 (ML) 技术有望提供一种数据驱动的排队分析替代方案。然而，现有的工作并没有对可能对准确性产生重大影响的任务提供清晰的直觉，例如 ML 技术选择、特征化和训练数据选择。我的程序将解决这一知识差距并实现自动预测技术，不会给操作员带来此类任务的负担。我们还将探索运行时技术来减轻突发性和干扰的影响。现有的工作并未集中于处理服务需求突发性的不利影响，即导致系统资源持续高或低利用率的用户事务模式。我们的初步工作表明，可以通过智能地重新排序传入事务，使用更少的资源来抑制这种突发性。我们将基于这一见解来实现新的运行时调度技术。作为该主题的一部分，我们还将利用我们正在进行的干扰检测工作来自动扩展云资源实例（例如容器）以响应干扰。现有方法没有考虑单个交易类型如何受到给定实例的干扰的影响。我们将构建可以使用此类细粒度信息智能地将事务分配到实例的模型，以便使用最少的实例来减轻干扰。该计划将扩展数据驱动的性能预测和管理研究的最新技术。加拿大组织可以利用这项研究来降低与绩效不佳和资源过度配置相关的成本。