Speculative Parallelization of Partially Parallel Loops
Authors: Francis H. Dang, Lawrence Rauchwerger
Venue: Languages, Compilers, and Run-Time Systems for Scalable Computers (LCR.) Lecture Notes in Computer Science
DOI: 10.1007/3-540-40889-4_22
Link to Publication
Abstract:
Current parallelizing compilers cannot identify a significant fraction of parallelizable loops because they have complex or statically insufficiently de- fined access patterns. We have previously proposed a framework for their identifi- cation. We speculatively executed a loop as a doall, and applied a fully parallel data dependence test to determine if it had any cross-processor dependences; if the test failed, then the loop was re-executed serially. While this method ex- ploits doall parallelism well, it can cause slowdowns for loops with even one cross-processor flow dependence because we have to re-execute sequentially. Moreover, the existing, partial parallelism of loops is not exploited. In this paper we propose a generalization of our speculative doall parallelization technique, named Recursive LRPD test, that can extract and exploit the maximum available parallelism of any loop and that limits potential slowdowns to the overhead of the run-time dependence test itself, i.e., removes the time lost due to incorrect parallel execution. The asymptotic time-complexity is, for fully serial loops, equal to the sequential execution time. We present the base algorithm and an analysis of the different heuristics for its practical application. Some preliminary experimental results on loops from Track will show the performance of this new technique.
@inproceedings{Dang-spoppl-2000,
address = {Berlin, Heidelberg},
author = {Dang, Francis H.
and Rauchwerger, Lawrence},
booktitle = {Languages, Compilers, and Run-Time Systems for Scalable Computers},
editor = {Dwarkadas, Sandhya},
isbn = {978-3-540-40889-5},
pages = {285--299},
publisher = {Springer Berlin Heidelberg},
title = {Speculative Parallelization of Partially Parallel Loops},
year = {2000}
}