public class UnionOptimizer extends TezOpPlanVisitor
mCurrentWalker, mPlan| Constructor and Description |
|---|
UnionOptimizer(TezOperPlan plan,
List<String> supportedStoreFuncs,
List<String> unsupportedStoreFuncs) |
| Modifier and Type | Method and Description |
|---|---|
void |
connectPredecessorsToVertexGroups(TezOperator unionOp,
TezOperator pred,
PhysicalPlan predClonedUnionPlan,
TezOperator[] storeVertexGroupOps,
TezOperator[] outputVertexGroupOps)
Connects the unionOp predecessor to the store vertex groups and the output vertex groups
and disconnects it from the unionOp.
|
static PhysicalPlan |
getUnionPredPlanFromSplit(PhysicalPlan plan,
String unionOpKey) |
static boolean |
isOptimizable(TezOperator tezOp) |
static boolean |
isOptimizableStoreFunc(TezOperator tezOp,
List<String> supportedStoreFuncs,
List<String> unsupportedStoreFuncs) |
void |
visitTezOp(TezOperator tezOp) |
getPlan, popWalker, pushWalker, visitpublic UnionOptimizer(TezOperPlan plan, List<String> supportedStoreFuncs, List<String> unsupportedStoreFuncs)
public static boolean isOptimizable(TezOperator tezOp) throws VisitorException
VisitorExceptionpublic static boolean isOptimizableStoreFunc(TezOperator tezOp, List<String> supportedStoreFuncs, List<String> unsupportedStoreFuncs) throws VisitorException
VisitorExceptionpublic void visitTezOp(TezOperator tezOp) throws VisitorException
visitTezOp in class TezOpPlanVisitorVisitorExceptionpublic void connectPredecessorsToVertexGroups(TezOperator unionOp, TezOperator pred, PhysicalPlan predClonedUnionPlan, TezOperator[] storeVertexGroupOps, TezOperator[] outputVertexGroupOps) throws VisitorException, PlanException
pred - Predecessor of union which will be made part of the vertex groupunionOp - Union operatorpredClonedUnionPlan - Cloned plan of the union merged to the predecessorstoreVertexGroupOps - Store vertex groups to connect tooutputVertexGroupOps - Tez LogicalOutput vertex groups to connect toVisitorExceptionPlanExceptionpublic static PhysicalPlan getUnionPredPlanFromSplit(PhysicalPlan plan, String unionOpKey) throws VisitorException
VisitorExceptionCopyright © 2007-2017 The Apache Software Foundation