[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider - #9571

Closed

steveloughran wants to merge 22 commits into

apache:masterfrom

steveloughran:feature/SPARK-11373

Commits on Apr 10, 2017

[SPARK-11373] First pass at adding metrics to the history server, with the FsHistoryProvider counting
Steve Loughran
committed
8267974
[SPARK-11373] tests and review; found and fixed a re-entrancy in HistoryServerSuite which was causing problems with counter registration
Steve Loughran
committed
0825756
[SPARK-11373] scala-style javadoc tuning in FsHistoryProvider
Steve Loughran
committed
9e63bcf
SPARK-11373: move to MetricsSystem, though retaining/expanding health checks, which aren't part of it
Steve Loughran
committed
a658769
scalacheck
Steve Loughran
committed
f02323f
SPARK-11373: cut out the notion of binding information; simplify provider launch
Steve Loughran
committed
dbde3ab
SPARK-11373 cut the health checks out
Steve Loughran
committed
59a4a67
[SPARK-11373] tail end of rebase operation
Steve Loughran
committed
4c30404
[SPARK-11373] scalastyle and import ordering
Steve Loughran
committed
ee74f81
SPARK-11373 finish review of merge with trunk; add new Timestamp gauge and set to time of update/update success. Makes update time visible for tests/users/ops
Steve Loughran
committed
a3a6383
[SPARK-11373] finish rebasing to master, correct tightened style checks

steveloughran
authored and
Steve Loughran
committed
e936d5b
[SPARK-11373] Address review comments and add a new counter of events played back during merge and U load

steveloughran
authored and
Steve Loughran
committed
cef1577
[SPARK-11373] more metrics, all sources have prefixes, common features pulled up into HistoryMetricSource, including registration and prefix support. The existing test case "incomplete apps get ref…

steveloughran
authored and
Steve Loughran
committed
4bf9d13
[SPARK-11373] add a check that before there's been any events loaded, the average load time is "0" and not a division by zero error. This validates the logic in the relevant lambda-expression

steveloughran
authored and
Steve Loughran
committed
818e14b
[SPARK-11373] style check in the javadocs

steveloughran
authored and
Steve Loughran
committed
bfea17f
[SPARK-11373] IDE had mysteriously re-ordered imports in the same line. Interesting, and not in a good way

steveloughran
authored and
Steve Loughran
committed
b01facd
[SPARK-11373] address latest comments

steveloughran
authored and
Steve Loughran
committed
a956243
[SPARK-1137] cull surplus lines

steveloughran
authored and
Steve Loughran
committed
50727e7
[SPARK-11373] don't register appui.load.timer as a metric

steveloughran
authored and
Steve Loughran
committed
012cf92
[SPARK-11373] sync with master; tests all happy

steveloughran
authored and
Steve Loughran
committed
1e59b68
[SPARK-11373] sync this PR up with the master branch

steveloughran
authored and
Steve Loughran
committed
ec1f2d7

Commits on Apr 11, 2017

HADOOP-11374 fix line length errors
Steve Loughran
committed
8903dcf

Navigation Menu

Uh oh!

[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider - #9571

[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider#9571
steveloughran wants to merge 22 commits into
apache:masterfrom
steveloughran:feature/SPARK-11373

Commits on Apr 10, 2017

[SPARK-11373] First pass at adding metrics to the history server, with the FsHistoryProvider counting

[SPARK-11373] tests and review; found and fixed a re-entrancy in HistoryServerSuite which was causing problems with counter registration

[SPARK-11373] scala-style javadoc tuning in FsHistoryProvider

SPARK-11373: move to MetricsSystem, though retaining/expanding health checks, which aren't part of it

scalacheck

SPARK-11373: cut out the notion of binding information; simplify provider launch

SPARK-11373 cut the health checks out

[SPARK-11373] tail end of rebase operation

[SPARK-11373] scalastyle and import ordering

SPARK-11373 finish review of merge with trunk; add new Timestamp gauge and set to time of update/update success. Makes update time visible for tests/users/ops

[SPARK-11373] finish rebasing to master, correct tightened style checks

[SPARK-11373] Address review comments and add a new counter of events played back during merge and U load

[SPARK-11373] more metrics, all sources have prefixes, common features pulled up into HistoryMetricSource, including registration and prefix support. The existing test case "incomplete apps get ref…

[SPARK-11373] add a check that before there's been any events loaded, the average load time is "0" and not a division by zero error. This validates the logic in the relevant lambda-expression

[SPARK-11373] style check in the javadocs

[SPARK-11373] IDE had mysteriously re-ordered imports in the same line. Interesting, and not in a good way

[SPARK-11373] address latest comments

[SPARK-1137] cull surplus lines

[SPARK-11373] don't register appui.load.timer as a metric

[SPARK-11373] sync with master; tests all happy

[SPARK-11373] sync this PR up with the master branch

Commits on Apr 11, 2017

HADOOP-11374 fix line length errors