Enabling and optimizing pilot jobs using XEN virtual machines for hpc grid applications

O. Khalid, R. Anthony, P. Nilsson, K. Keahey, M. Schulz, K. Parrot, Miltiadis Petridis

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBN

Abstract

The primary motivation for uptake of virtualization have been resource isolation, capacity management and resource customization: isolation and capacity management allow providers to isolate users from the site and control their resources usage while customization allows end-users to easily project the required environment onto a variety of sites. Various approaches have been taken to integrate virtualization with Grid technologies. In this paper, we propose an approach that combines virtualization on the existing software infrastructure such as Pilot Jobs with minimum change on the part of resource providers. We also present a standard API to enable a wider set of applications including Batch systems to deploy virtual machines on-demand as isolated job sandboxes. To illustrate the usefulness of this approach, we also evaluate the impact of Xen virtualization on memory and compute intensive tasks, and present our results that how memory and scheduling parameters could be tweaked to optimize job performance.
Original languageEnglish
Title of host publicationVTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing
PublisherIEEE
Pages1-8
Number of pages8
ISBN (Print)9781605585802
DOIs
Publication statusPublished - Jun 2009
EventVTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing - Barcelona, Spain, 15th June, 2009
Duration: 1 Jun 2009 → …

Workshop

WorkshopVTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing
Period1/06/09 → …

Fingerprint Dive into the research topics of 'Enabling and optimizing pilot jobs using XEN virtual machines for hpc grid applications'. Together they form a unique fingerprint.

  • Cite this

    Khalid, O., Anthony, R., Nilsson, P., Keahey, K., Schulz, M., Parrot, K., & Petridis, M. (2009). Enabling and optimizing pilot jobs using XEN virtual machines for hpc grid applications. In VTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing (pp. 1-8). IEEE. https://doi.org/10.1145/1555336.1555338