Resolve Jenkins fails with Angular Material and Angular 1.3.x

[ThomasBurleson]

Jenkins AngularJS Material Testings

Safari 6.2.8 (Mac OS X 10.8.5) md-input-container directive should show error on $submitted and $invalid FAILED
 Expected '<md-input-container class=""><input ng-model="foo" class="ng-pristine ng-untouched ng-valid md-input" id="input_113" tabindex="0" aria-invalid="true"><div class="md-errors-spacer"></div><label for="input_113"></label></md-input-container>to have class 'md-input-invalid'.
 /Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/input/input.spec.js:74:54
................................................................................
................................................................................
................................................................................
................................................................................
................................................................................
................................................................................
................................................................................
................................................................................
......................................................................
Safari 6.2.8 (Mac OS X 10.8.5) <md-toolbar> works with ng-show FAILED
 Expected '0px' not to equal '0px'.
 /Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/toolbar/toolbar.spec.js:167:48
 invoke@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular/angular.js:4219:22
 workFn@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular-mocks/angular-mocks.js:2475:26
Safari 6.2.8 (Mac OS X 10.8.5) <md-toolbar> works with ng-hide FAILED
 Expected '-32px' to equal '0px'.
 /Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/toolbar/toolbar.spec.js:219:44
 invoke@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular/angular.js:4219:22
 workFn@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular-mocks/angular-mocks.js:2475:26
................................................................................
................................................................................
................................................................................
....................................................
Chrome 47.0.2526 (Mac OS X 10.8.5) md-input-container directive should show error on $submitted and $invalid FAILED
 Expected '<md-input-container class=""><input ng-model="foo" class="ng-pristine ng-untouched ng-valid md-input" id="input_113" tabindex="0" aria-invalid="true"><div class="md-errors-spacer"></div><label for="input_113"></label></md-input-container>to have class 'md-input-invalid'.
 at Object.<anonymous> (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/input/input.spec.js:74:43)
................................................................................
................................................................................
......................
Safari 6.2.8 (Mac OS X 10.8.5): Executed 1840 of 1849 (3 FAILED) (skipped 9) (38.579 secs / 37.777 secs)
................................................................................
................................................................................
................................................................................
............................................................
Chrome 47.0.2526 (Mac OS X 10.8.5) <md-toolbar> works with ng-show FAILED
 Expected '0px' not to equal '0px'.
 at Object.<anonymous> (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/toolbar/toolbar.spec.js:167:41)
 at Object.invoke (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular/angular.js:4219:17)
 at Object.workFn (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular-mocks/angular-mocks.js:2475:20)
Chrome 47.0.2526 (Mac OS X 10.8.5) <md-toolbar> works with ng-hide FAILED
 Expected '-32px' to equal '0px'.
 at Object.<anonymous> (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/toolbar/toolbar.spec.js:219:37)
 at Object.invoke (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular/angular.js:4219:17)
 at Object.workFn (/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular-mocks/angular-mocks.js:2475:20)
...........
Firefox 43.0.0 (Mac OS X 10.8.0) md-input-container directive should show error on $submitted and $invalid FAILED
 Expected '<md-input-container class=""><input aria-invalid="true" tabindex="0" id="input_113" class="ng-pristine ng-untouched ng-valid md-input" ng-model="foo"><div class="md-errors-spacer"></div><label for="input_113"></label></md-input-container>to have class 'md-input-invalid'.
 @/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/input/input.spec.js:74:5
................................................................................
................................................................................
...........................................
Chrome 47.0.2526 (Mac OS X 10.8.5): Executed 1840 of 1849 (3 FAILED) (skipped 9) (50.363 secs / 49.607 secs)
................................................................................
..................
Firefox 43.0.0 (Mac OS X 10.8.0) <md-toolbar> works with ng-show FAILED
 Expected '0px' not to equal '0px'.
 @/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/toolbar/toolbar.spec.js:167:5
 invoke@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular/angular.js:4219:14
 workFn@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular-mocks/angular-mocks.js:2475:11
Firefox 43.0.0 (Mac OS X 10.8.0) <md-toolbar> works with ng-hide FAILED
 Expected '-24px' to equal '0px'.
 @/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/src/components/toolbar/toolbar.spec.js:219:5
 invoke@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular/angular.js:4219:14
 workFn@/Users/jenkins/JenkinsHome/workspace/angularjs-material-version-testing/node_modules/angular-mocks/angular-mocks.js:2475:11
.......................................
Firefox 43.0.0 (Mac OS X 10.8.0): Executed 1840 of 1849 (3 FAILED) (skipped 9) (57.329 secs / 55.872 secs)
TOTAL: 9 FAILED, 5511 SUCCESS
[02:07:04] Karma exited with the following exit code: 1

[topherfangio]

@ThomasBurleson Pretty sure this is just waiting on PRs to get merged: #6550 and #6276.

[ThomasBurleson]

Odd issue still causing Jenkins Failures in Angular 1.3.2:

Chrome 47.0.2526 (Mac OS X 10.8.5): Executed 1848 of 1857 (skipped 9) SUCCESS (48.347 secs / 47.611 secs)
Chrome 47.0.2526 (Mac OS X 10.8.5) ERROR
 Some of your tests did a full page reload!
Chrome 47.0.2526 (Mac OS X 10.8.5): Executed 1848 of 1857 (skipped 9) ERROR (48.367 secs / 47.611 secs)
................................................................................
................................................................................
....
Firefox 43.0.0 (Mac OS X 10.8.0): Executed 1848 of 1857 (skipped 9) SUCCESS (55.863 secs / 54.373 secs)
[02:07:09] Karma exited with the following exit code: 1


--- Finished Testing AngularMaterial against AngularJS (1.3.20) ---
STATUS: FAILED

See Stack Overflow Help for head hook for debugging.

Attn: @topherfangio

[topherfangio]

Digging in now.

[topherfangio]

@matsko Could use your feedback on this Jenkins issue. Have two potential solutions:

1. We are thinking of adding concurrency: 1 to the karma.conf so it only runs a single browser instance at a time. I was seeing issues far more often when running Safari and Chrome together and setting this alleviated those. You have any feedback on this, good or bad?
2. It looks like the Jenkins task isn't copying of the proper versions of angular-sanitize and angular-touch (it simply doesn't copy them). I'm not sure if it's currently causing an issue, but I can definitely see some issues down the road.

From the console output:

--- Testing AngularMaterial against AngularJS (1.3.20) ---

[copy] copied over ./tmp/angular-1.3.20/files/angular.js to ./node_modules/angular/angular.js
[copy] copied over ./tmp/angular-1.3.20/files/angular.min.js to ./node_modules/angular/angular.min.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-animate.js to ./node_modules/angular-animate/angular-animate.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-animate.min.js to ./node_modules/angular-animate/angular-animate.min.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-route.js to ./node_modules/angular-route/angular-route.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-route.min.js to ./node_modules/angular-route/angular-route.min.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-aria.js to ./node_modules/angular-aria/angular-aria.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-aria.min.js to ./node_modules/angular-aria/angular-aria.min.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-messages.js to ./node_modules/angular-messages/angular-messages.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-messages.min.js to ./node_modules/angular-messages/angular-messages.min.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-mocks.js to ./node_modules/angular-mocks/angular-mocks.js
[copy] copied over ./tmp/angular-1.3.20/files/angular-mocks.min.js to ./node_modules/angular-mocks/angular-mocks.min.js

[02:05:41] Using gulpfile ~/JenkinsHome/workspace/angularjs-material-version-testing/gulpfile.js
[02:05:41] Starting 'build-scss'...

Think you could fix point 2 above and provide some feedback on point 1?