ePrints

Adaptive workload allocation in query processing in autonomous heterogeneous environments

Lookup NU author(s): Professor Paul WatsonORCiD

Downloads

• Accepted version [.pdf]

Abstract

The increasing prevalence of networked storage and computational resources, along with middleware for managing resource access and sharing, raises the prospect that queries can be run over resources obtained on demand, rather than on dedicated infrastructures. However, the movement of query processing into non-dedicated environments means that it is necessary to take account of the partial information and unstable conditions that characterise autonomous, shared, distributed settings. Thus, query processing on grid platforms needs to be adaptive, revising evaluation strategies at query runtime in response to the evolving environment, such as changes to machine load and availability. To address this challenge, adaptive techniques are described that: (i) balance load across plan partitions supporting intra-operator parallelism; (ii) remove bottlenecks in pipelined plans supporting inter-operator parallelism; and (iii) combine the two aforementioned techniques. The approach has been empirically evaluated in a grid-enabled adaptive query processor.

Publication metadata

Author(s): Gounaris A, Smith J, Paton NW, Sakellariou R, Fernandes AAA, Watson P

Publication type: Article

Publication status: Published

Journal: Distributed and Parallel Databases

Year: 2009

Volume: 25

Issue: 3

Pages: 125-164

Date deposited: 10/06/2010

ISSN (print): 0926-8782

ISSN (electronic): 1573-7578

Publisher: Springer New York LLC

URL: http://dx.doi.org/10.1007/s10619-008-7032-5

DOI: 10.1007/s10619-008-7032-5

Altmetrics

Share