| Class and Description |
|---|
| JobMetricsListener |
| SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
| SparkExecType |
| SparkLauncher.ResourceType |
| SparkPigContext
singleton class like PigContext
|
| SparkPigSplit
Wrapper class for PigSplits in Spark mode
Spark only counts HDFS bytes read if we provide a FileSplit, so we have to wrap PigSplits and have the wrapper
class extend FileSplit
|
| Class and Description |
|---|
| SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
| Class and Description |
|---|
| JobMetricsListener |
Copyright © 2007-2017 The Apache Software Foundation