ci: move most of the prepare config into scripts by emilyalbini · Pull Request #65202 · rust-lang/rust

emilyalbini · 2019-10-08T11:16:29Z

This PR moves most of the configuration from the CI yamls into bash scripts, driven by a small Python script (which understands and emulates the two ##vso[ commands we use).

There are two reasons why we'd want to do this:

Being able to prepare the build environment locally by just running src/ci/prepare.py simplifies a lot setting up a local VM similar to CI (software pre-installed in the CI images won't be prepared, but it's a start anyway).
When we'll switch to GitHub Actions we'll need to either duplicate code in multiple workflows or write a preprocessor. Having all the prepare steps in a single one is going to simplify the implementation of both options.

Along with the move I did a few changes to the actual scripts:

Mirrored all the remaining external URLs we download (except chocolatey) to the rust-lang-ci-mirrors bucket, to increase reliability and reduce the chance of supply chain attacks. I didn't audit and mirror the CI scripts outside this PR though.
Extracted CI-specific behavior (like issuing ##vso[ commands and detecting the host platform) into shared.sh and included it in most of the scripts. This way a switch to another CI provider will be less painful.

It's possible (and easier) to review this commit-by-commit.
r? @alexcrichton
cc @rust-lang/infra

rust-highfive · 2019-10-08T11:37:31Z

The job x86_64-gnu-llvm-6.0 of your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2019-10-08T11:17:05.0285704Z ##[command]git remote add origin https://github.com/rust-lang/rust
2019-10-08T11:17:05.0495783Z ##[command]git config gc.auto 0
2019-10-08T11:17:05.0588106Z ##[command]git config --get-all http.https://github.com/rust-lang/rust.extraheader
2019-10-08T11:17:05.0659617Z ##[command]git config --get-all http.proxy
2019-10-08T11:17:05.0798391Z ##[command]git -c http.extraheader="AUTHORIZATION: basic ***" fetch --force --tags --prune --progress --no-recurse-submodules --depth=2 origin +refs/heads/*:refs/remotes/origin/* +refs/pull/65202/merge:refs/remotes/pull/65202/merge
---
2019-10-08T11:23:47.1619789Z Compiling serde_json v1.0.40
2019-10-08T11:23:48.9290740Z Compiling tidy v0.1.0 (/checkout/src/tools/tidy)
2019-10-08T11:23:59.9722143Z Finished release [optimized] target(s) in 1m 28s
2019-10-08T11:23:59.9800235Z tidy check
2019-10-08T11:24:00.4097909Z tidy error: /checkout/src/ci/scripts/install-clang.sh:41: line longer than 100 chars
2019-10-08T11:24:00.4098515Z tidy error: /checkout/src/ci/scripts/install-innosetup.sh:14: line longer than 100 chars
2019-10-08T11:24:00.4099018Z tidy error: /checkout/src/ci/scripts/enable-docker-ipv6.sh:12: line longer than 100 chars
2019-10-08T11:24:00.4099250Z tidy error: /checkout/src/ci/scripts/install-ninja.sh:11: line longer than 100 chars
2019-10-08T11:24:00.4099474Z tidy error: /checkout/src/ci/scripts/install-mingw.sh:41: line longer than 100 chars
2019-10-08T11:24:02.1016778Z some tidy checks failed
2019-10-08T11:24:02.1022892Z 2019-10-08T11:24:02.1022892Z 2019-10-08T11:24:02.1023925Z command did not execute successfully: "/checkout/obj/build/x86_64-unknown-linux-gnu/stage0-tools-bin/tidy" "/checkout/src" "/checkout/obj/build/x86_64-unknown-linux-gnu/stage0/bin/cargo" "--no-vendor"
2019-10-08T11:24:02.1024041Z 2019-10-08T11:24:02.1024095Z 2019-10-08T11:24:02.1029354Z failed to run: /checkout/obj/build/bootstrap/debug/bootstrap test src/tools/tidy
2019-10-08T11:24:02.1029663Z Build completed unsuccessfully in 0:01:31
2019-10-08T11:24:02.1029663Z Build completed unsuccessfully in 0:01:31
2019-10-08T11:24:02.1086864Z == clock drift check ==
2019-10-08T11:24:02.1110882Z local time: Tue Oct 8 11:24:02 UTC 2019
2019-10-08T11:24:02.2600013Z network time: Tue, 08 Oct 2019 11:24:02 GMT
2019-10-08T11:24:02.2603874Z == end clock drift check ==
2019-10-08T11:24:03.6450517Z ##[error]Bash exited with code '1'.
2019-10-08T11:24:03.6500949Z ##[section]Starting: Checkout
2019-10-08T11:24:03.6503139Z ==============================================================================
2019-10-08T11:24:03.6503201Z Task : Get sources
2019-10-08T11:24:03.6503273Z Description : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

alexcrichton · 2019-10-10T00:23:51Z

@bors: r+

Thanks for this @pietroalbini!

bors · 2019-10-10T00:23:52Z

📌 Commit 1591a8e has been approved by alexcrichton

emilyalbini · 2019-10-10T06:32:16Z

@bors rollup=never

At least for linux we're sure it works (the PR builders were fine), but there is a chance I forgot to copy something/typoed stuff for the other platforms, and I don't want this to affect a rollup.

bors · 2019-10-13T11:33:30Z

⌛ Testing commit 1591a8e with merge f973dbb260d9d091ec71666190125d1df9d1abe6...

bors · 2019-10-13T11:36:48Z

💔 Test failed - checks-azure

rust-highfive · 2019-10-13T11:36:48Z

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2019-10-13T11:34:55.9566367Z do so (now or later) by using -b with the checkout command again. Example:
2019-10-13T11:34:55.9566506Z 2019-10-13T11:34:55.9566636Z git checkout -b <new-branch-name>
2019-10-13T11:34:55.9567164Z 2019-10-13T11:34:55.9568177Z HEAD is now at f973dbb26 Auto merge of #65202 - pietroalbini:scriptify-ci-config, r=alexcrichton
2019-10-13T11:34:55.9941989Z ##[section]Starting: Collect CPU-usage statistics in the background
2019-10-13T11:34:56.0065799Z ==============================================================================
2019-10-13T11:34:56.0065909Z Task : Bash
2019-10-13T11:34:56.0065980Z Description : Run a Bash script on macOS, Linux, or Windows
---
2019-10-13T11:34:56.7293520Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc -c pwd
2019-10-13T11:34:56.7694809Z /d/a/_temp
2019-10-13T11:34:56.7783167Z ========================== Starting Command Output ===========================
2019-10-13T11:34:56.7802821Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/5cfb4553-5c08-4566-bb58-77fe814c5c10.sh
2019-10-13T11:34:57.0392110Z /usr/bin/env: 'python3': No such file or directory
2019-10-13T11:34:57.0535809Z ##[error]Bash exited with code '127'.
2019-10-13T11:34:57.0550119Z ##[section]Finishing: Prepare the CI environment
2019-10-13T11:34:57.0728297Z ==============================================================================
2019-10-13T11:34:57.0728414Z Task : Bash
2019-10-13T11:34:57.0728525Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-13T11:34:57.0728611Z Version : 3.151.3
---
2019-10-13T11:34:57.3550103Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc -c pwd
2019-10-13T11:34:57.3904319Z /d/a/_temp
2019-10-13T11:34:57.3983344Z ========================== Starting Command Output ===========================
2019-10-13T11:34:57.4000146Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/aa2921f7-209f-41d0-ba9b-34e6e15b619f.sh
2019-10-13T11:34:57.4446083Z /d/a/_temp/aa2921f7-209f-41d0-ba9b-34e6e15b619f.sh: line 1: aws: command not found
2019-10-13T11:34:57.4502010Z ##[error]Bash exited with code '127'.
2019-10-13T11:34:57.4579257Z ##[section]Starting: Checkout
2019-10-13T11:34:57.4690366Z ==============================================================================
2019-10-13T11:34:57.4690477Z Task : Get sources
2019-10-13T11:34:57.4690576Z Description : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

kennytm · 2019-10-13T13:47:34Z

aws: command not found on Windows.

Centril · 2019-10-13T21:37:58Z

@bors r- (bors sync goes badly...)

emilyalbini · 2019-10-14T06:11:55Z

This wasn't actually awscli missing, but the whole prepare step failed to run as it used #!/usr/bin/env python3, while on the Windows agents only python.exe is present. Added a new step to copy python.exe to python3.exe before executing the prepare script.

@bors r=alexcrichton

bors · 2019-10-14T06:11:57Z

📌 Commit 8d1c3ff has been approved by alexcrichton

bors · 2019-10-14T15:41:11Z

⌛ Testing commit 8d1c3ff with merge a103c61b9ccbce6c6f65b03d349efbad6c906a35...

rust-highfive · 2019-10-14T15:44:28Z

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2019-10-14T15:42:39.1411382Z do so (now or later) by using -b with the checkout command again. Example:
2019-10-14T15:42:39.1411821Z 2019-10-14T15:42:39.1412362Z git checkout -b <new-branch-name>
2019-10-14T15:42:39.1413401Z 2019-10-14T15:42:39.1414956Z HEAD is now at a103c61b9 Auto merge of #65202 - pietroalbini:scriptify-ci-config, r=alexcrichton
2019-10-14T15:42:39.1774570Z ##[section]Finishing: Checkout
2019-10-14T15:42:39.1906405Z ##[section]Starting: Copy python.exe to python3.exe
2019-10-14T15:42:39.2054625Z Task : Bash
2019-10-14T15:42:39.2054698Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-14T15:42:39.2054786Z Version : 3.151.3
2019-10-14T15:42:39.2054847Z Author : Microsoft Corporation
2019-10-14T15:42:39.2054847Z Author : Microsoft Corporation
2019-10-14T15:42:39.2054944Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-14T15:42:39.2055051Z ==============================================================================
2019-10-14T15:42:39.4543072Z Generating script.
2019-10-14T15:42:39.4753647Z Script contents:
2019-10-14T15:42:39.4753754Z cp $(which python) $(dirname $(which python))/python3.exe
2019-10-14T15:42:39.5185261Z /d/a/_temp
2019-10-14T15:42:39.5257973Z ========================== Starting Command Output ===========================
2019-10-14T15:42:39.5266878Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/ff005c95-8054-45b4-8d20-9a4c14409d20.sh
2019-10-14T15:42:39.5266878Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/ff005c95-8054-45b4-8d20-9a4c14409d20.sh
2019-10-14T15:42:39.9225103Z ##[section]Finishing: Copy python.exe to python3.exe
2019-10-14T15:42:39.9354030Z ==============================================================================
2019-10-14T15:42:39.9354118Z Task : Bash
2019-10-14T15:42:39.9354209Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-14T15:42:39.9354277Z Version : 3.151.3
---
2019-10-14T15:42:40.6946372Z ========================== Starting Command Output ===========================
2019-10-14T15:42:40.6974190Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/538bcdc1-6201-47e5-a9b8-9bf6374e2be5.sh
2019-10-14T15:42:42.5321686Z ==== Show the current environment ====
2019-10-14T15:42:42.6037975Z Traceback (most recent call last):
2019-10-14T15:42:42.6044451Z File "src/ci/prepare.py", line 93, in <module>
2019-10-14T15:42:42.6065675Z run(Build())
2019-10-14T15:42:42.6065818Z File "src/ci/prepare.py", line 9, in run
2019-10-14T15:42:42.6065915Z b.step("dump-environment.sh", "Show the current environment")
2019-10-14T15:42:42.6066030Z File "src/ci/prepare.py", line 63, in step
2019-10-14T15:42:42.6066120Z stdout=subprocess.PIPE, stderr=subprocess.STDOUT,
2019-10-14T15:42:42.6066247Z File "C:\hostedtoolcache\windows\Python\3.6.8\x64\lib\subprocess.py", line 729, in __init__
2019-10-14T15:42:42.6066358Z restore_signals, start_new_session)
2019-10-14T15:42:42.6067130Z File "C:\hostedtoolcache\windows\Python\3.6.8\x64\lib\subprocess.py", line 1017, in _execute_child
2019-10-14T15:42:42.6067297Z startupinfo)
2019-10-14T15:42:42.6067385Z OSError: [WinError 193] %1 is not a valid Win32 application
2019-10-14T15:42:42.6363394Z ##[error]Bash exited with code '1'.
2019-10-14T15:42:42.6572272Z ##[section]Finishing: Prepare the CI environment
2019-10-14T15:42:42.7073475Z ==============================================================================
2019-10-14T15:42:42.7073584Z Task : Bash
2019-10-14T15:42:42.7073655Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-14T15:42:42.7073736Z Version : 3.151.3
---
2019-10-14T15:42:43.1372960Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc -c pwd
2019-10-14T15:42:43.2024724Z /d/a/_temp
2019-10-14T15:42:43.2554441Z ========================== Starting Command Output ===========================
2019-10-14T15:42:43.2555216Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/bb4006b7-6135-4204-89cc-c438644dca5b.sh
2019-10-14T15:42:43.3650097Z /d/a/_temp/bb4006b7-6135-4204-89cc-c438644dca5b.sh: line 1: aws: command not found
2019-10-14T15:42:43.3796243Z ##[error]Bash exited with code '127'.
2019-10-14T15:42:43.3860654Z ##[section]Starting: Checkout
2019-10-14T15:42:43.3993917Z ==============================================================================
2019-10-14T15:42:43.3994044Z Task : Get sources
2019-10-14T15:42:43.3994302Z Description : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

bors · 2019-10-14T15:44:38Z

💔 Test failed - checks-azure

I mistakenly inverted the "variable is not set" check in bash.

A few dist builders lacked that variable, causing build failures.

emilyalbini · 2019-10-25T14:55:14Z

@bors try

bors · 2019-10-25T14:55:24Z

⌛ Trying commit c0075d8 with merge 30110db...

@alexcrichton

ci: move most of the prepare config into scripts This PR moves most of the configuration from the CI yamls into bash scripts, driven by a small Python script (which understands and emulates the two `##vso[` commands we use). There are two reasons why we'd want to do this: * Being able to prepare the build environment locally by just running `src/ci/prepare.py` simplifies a lot setting up a local VM similar to CI (software pre-installed in the CI images won't be prepared, but it's a start anyway). * When we'll switch to GitHub Actions we'll need to either duplicate code in multiple workflows or write a preprocessor. Having all the prepare steps in a single one is going to simplify the implementation of both options. Along with the move I did a few changes to the actual scripts: * Mirrored all the remaining external URLs we download (except chocolatey) to the `rust-lang-ci-mirrors` bucket, to increase reliability and reduce the chance of supply chain attacks. I didn't audit and mirror the CI scripts outside this PR though. * Extracted CI-specific behavior (like issuing `##vso[` commands and detecting the host platform) into `shared.sh` and included it in most of the scripts. This way a switch to another CI provider will be less painful. It's possible (and easier) to review this commit-by-commit. r? @alexcrichton cc @rust-lang/infra

rust-highfive · 2019-10-25T18:16:03Z

The job dist-x86_64-msvc of your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2019-10-25T15:10:12.4177014Z do so (now or later) by using -b with the checkout command again. Example:
2019-10-25T15:10:12.4177070Z 2019-10-25T15:10:12.4177153Z git checkout -b <new-branch-name>
2019-10-25T15:10:12.4178750Z 2019-10-25T15:10:12.4178985Z HEAD is now at 30110dbd2 Auto merge of #65202 - pietroalbini:scriptify-ci-config, r=<try>
2019-10-25T15:10:12.4538525Z ##[section]Starting: Collect CPU-usage statistics in the background
2019-10-25T15:10:12.4635408Z ==============================================================================
2019-10-25T15:10:12.4635519Z Task : Bash
2019-10-25T15:10:12.4635600Z Description : Run a Bash script on macOS, Linux, or Windows
---
2019-10-25T15:10:12.7937972Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:10:12.7938070Z ==============================================================================
2019-10-25T15:10:13.0138812Z Generating script.
2019-10-25T15:10:13.0240621Z Script contents:
2019-10-25T15:10:13.0240972Z src/ci/scripts/dump-environment.sh
2019-10-25T15:10:13.0590809Z /d/a/_temp
2019-10-25T15:10:13.0624280Z 2019-10-25T15:10:13.0655619Z ========================== Starting Command Output ===========================
2019-10-25T15:10:13.0660766Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/2856f71e-4781-4bfc-82e4-4b17bf20803d.sh
---
2019-10-25T15:10:13.2911052Z 2019-10-25T15:10:13.2911100Z 2019-10-25T15:10:13.2911135Z 2019-10-25T15:10:13.2911169Z 2019-10-25T15:10:13.2911339Z * Being able to prepare the build environment locally by just running `src/ci/prepare.py` simplifies a lot setting up a local VM similar to CI (software pre-installed in the CI images won't be prepared, but it's a start anyway).
2019-10-25T15:10:13.2952515Z ##[warning]'* Extracted CI-specific behavior (like issuing `##vso[` commands and detecting the host platform) into `shared.sh` and included it in most of the scripts. This way a switch to another CI provider will be less painful.' contains logging command keyword '##vso', but it's not a legal command. Please see the list of accepted commands: https://go.microsoft.com/fwlink/?LinkId=817296
2019-10-25T15:10:13.2964192Z * Extracted CI-specific behavior (like issuing `##vso[` commands and detecting the host platform) into `shared.sh` and included it in most of the scripts. This way a switch to another CI provider will be less painful.
2019-10-25T15:10:13.2964465Z * Mirrored all the remaining external URLs we download (except chocolatey) to the `rust-lang-ci-mirrors` bucket, to increase reliability and reduce the chance of supply chain attacks. I didn't audit and mirror the CI scripts outside this PR though.
2019-10-25T15:10:13.2964688Z * When we'll switch to GitHub Actions we'll need to either duplicate code in multiple workflows or write a preprocessor. Having all the prepare steps in a single one is going to simplify the implementation of both options.
2019-10-25T15:10:13.2964944Z AGENT_DISABLELOGPLUGIN_TESTFILEPUBLISHERPLUGIN=true
2019-10-25T15:10:13.2965033Z AGENT_DISABLELOGPLUGIN_TESTRESULTLOGPLUGIN=true
2019-10-25T15:10:13.2965126Z AGENT_HOMEDIRECTORY=C:\agents\2.159.2
2019-10-25T15:10:13.2965201Z AGENT_ID=568
---
2019-10-25T15:10:13.2973695Z BUILD_SOURCEBRANCHNAME=try
2019-10-25T15:10:13.2973781Z BUILD_SOURCESDIRECTORY=D:\a\1\s
2019-10-25T15:10:13.2973882Z BUILD_SOURCEVERSION=30110dbd27ed76e7510997883053bb0fda2becde
2019-10-25T15:10:13.2973964Z BUILD_SOURCEVERSIONAUTHOR=bors
2019-10-25T15:10:13.2974075Z BUILD_SOURCEVERSIONMESSAGE=Auto merge of #65202 - pietroalbini:scriptify-ci-config, r=<try>
2019-10-25T15:10:13.2974251Z COBERTURA_HOME=C:\cobertura-2.1.1
2019-10-25T15:10:13.2974334Z COMMONPROGRAMFILES=C:\Program Files\Common Files
2019-10-25T15:10:13.2974439Z COMMON_TESTRESULTSDIRECTORY=D:\a\1\TestResults
2019-10-25T15:10:13.2974528Z COMPUTERNAME=fv-az433
---
2019-10-25T15:10:13.2987799Z TMP=/tmp
2019-10-25T15:10:13.2987881Z TOOLSTATE_ISSUES_API_URL=https://api.github.com/repos/rust-lang/rust/issues
2019-10-25T15:10:13.2987978Z TOOLSTATE_PUBLISH=1
2019-10-25T15:10:13.2988084Z TOOLSTATE_REPO=https://github.com/rust-lang-nursery/rust-toolstate
2019-10-25T15:10:13.2988178Z There are two reasons why we'd want to do this:
2019-10-25T15:10:13.2988614Z ##[warning]'This PR moves most of the configuration from the CI yamls into bash scripts, driven by a small Python script (which understands and emulates the two `##vso[` commands we use).' contains logging command keyword '##vso', but it's not a legal command. Please see the list of accepted commands: https://go.microsoft.com/fwlink/?LinkId=817296
2019-10-25T15:10:13.2989028Z This PR moves most of the configuration from the CI yamls into bash scripts, driven by a small Python script (which understands and emulates the two `##vso[` commands we use).
2019-10-25T15:10:13.2989248Z USERDOMAIN=fv-az433
2019-10-25T15:10:13.2989335Z USERDOMAIN_ROAMINGPROFILE=fv-az433
2019-10-25T15:10:13.2989407Z USERNAME=VssAdministrator
2019-10-25T15:10:13.2989493Z USERPROFILE=C:\Users\VssAdministrator
---
2019-10-25T15:10:13.2990733Z r? @alexcrichton
2019-10-25T15:10:13.2990824Z 2019-10-25T15:10:13.2990900Z disk usage:
2019-10-25T15:10:13.3617359Z Filesystem Size Used Avail Use% Mounted on
2019-10-25T15:10:13.3623185Z C:/Program Files/Git 256G 140G 117G 55% /
2019-10-25T15:10:13.3623320Z D: 14G 2.0G 13G 14% /d
2019-10-25T15:10:13.3623559Z biggest files in the working dir:
2019-10-25T15:10:14.7794483Z 155452 .
2019-10-25T15:10:14.7794616Z 78411 ./src
2019-10-25T15:10:14.7794802Z 76391 ./.git
---
2019-10-25T15:10:31.9264479Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:10:31.9264596Z ==============================================================================
2019-10-25T15:10:32.1531804Z Generating script.
2019-10-25T15:10:32.1631706Z Script contents:
2019-10-25T15:10:32.1631996Z src/ci/scripts/switch-xcode.sh
2019-10-25T15:10:32.1978275Z /d/a/_temp
2019-10-25T15:10:32.2029696Z 2019-10-25T15:10:32.2058556Z ========================== Starting Command Output ===========================
2019-10-25T15:10:32.2064242Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/c073f9ce-5ae5-428f-9756-43397ae7e585.sh
---
2019-10-25T15:10:32.3086875Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:10:32.3086974Z ==============================================================================
2019-10-25T15:10:32.5353442Z Generating script.
2019-10-25T15:10:32.5459061Z Script contents:
2019-10-25T15:10:32.5459370Z src/ci/scripts/install-wix.sh
2019-10-25T15:10:32.5817186Z /d/a/_temp
2019-10-25T15:10:32.5852163Z 2019-10-25T15:10:32.5882063Z ========================== Starting Command Output ===========================
2019-10-25T15:10:32.5887282Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/11f14794-df64-4aee-a828-05e692b08ba1.sh
---
2019-10-25T15:10:37.1851378Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2019-10-25T15:10:37.1877515Z 100 1935k 100 1935k 0 0 2977k 0 --:--:-- --:--:-- --:--:-- 2977k
2019-10-25T15:10:41.8547067Z 2019-10-25T15:10:41.8620305Z ##[section]Finishing: Install InnoSetup
2019-10-25T15:10:41.8639635Z ##[section]Starting: Ensure the build happens on C:\ instead of D:\
2019-10-25T15:10:41.8743955Z Task : Bash
2019-10-25T15:10:41.8744056Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-25T15:10:41.8744135Z Version : 3.159.3
2019-10-25T15:10:41.8744220Z Author : Microsoft Corporation
2019-10-25T15:10:41.8744220Z Author : Microsoft Corporation
2019-10-25T15:10:41.8744307Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:10:41.8744423Z ==============================================================================
2019-10-25T15:10:42.0996256Z Generating script.
2019-10-25T15:10:42.1097355Z Script contents:
2019-10-25T15:10:42.1097659Z src/ci/scripts/windows-symlink-build-dir.sh
2019-10-25T15:10:42.1453478Z /d/a/_temp
2019-10-25T15:10:42.1486330Z 2019-10-25T15:10:42.1515705Z ========================== Starting Command Output ===========================
2019-10-25T15:10:42.1521273Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/a7bbd017-e994-4bd6-8a4d-544687a2f15f.sh
2019-10-25T15:10:42.1521273Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/a7bbd017-e994-4bd6-8a4d-544687a2f15f.sh
2019-10-25T15:10:42.2759554Z Junction created for build <<===>> c:\MORE_SPACE
2019-10-25T15:10:42.2817006Z 2019-10-25T15:10:42.2889964Z ##[section]Finishing: Ensure the build happens on C:\ instead of D:\
2019-10-25T15:10:42.2997831Z ==============================================================================
2019-10-25T15:10:42.2997950Z Task : Bash
2019-10-25T15:10:42.2998049Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-25T15:10:42.2998128Z Version : 3.159.3
---
2019-10-25T15:10:42.9113483Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:10:42.9113596Z ==============================================================================
2019-10-25T15:10:43.1374680Z Generating script.
2019-10-25T15:10:43.1482186Z Script contents:
2019-10-25T15:10:43.1482518Z src/ci/scripts/install-msys2.sh
2019-10-25T15:10:43.1843065Z /d/a/_temp
2019-10-25T15:10:43.1878419Z 2019-10-25T15:10:43.1909231Z ========================== Starting Command Output ===========================
2019-10-25T15:10:43.1915117Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/e5cf6cb7-cad4-4def-8507-b71e7af63c05.sh
---
2019-10-25T15:13:46.8446891Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:13:46.8447013Z ==============================================================================
2019-10-25T15:13:47.0734719Z Generating script.
2019-10-25T15:13:47.0751184Z Script contents:
2019-10-25T15:13:47.0751528Z src/ci/scripts/install-msys2-packages.sh
2019-10-25T15:13:47.1039139Z /d/a/_temp
2019-10-25T15:13:47.1053069Z 2019-10-25T15:13:47.1088851Z ========================== Starting Command Output ===========================
2019-10-25T15:13:47.1093911Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/67966d9b-1ff5-4bb9-9e5b-f9b36edd06c7.sh
---
2019-10-25T15:16:06.8344309Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:16:06.8344422Z ==============================================================================
2019-10-25T15:16:07.0832850Z Generating script.
2019-10-25T15:16:07.0860983Z Script contents:
2019-10-25T15:16:07.0861252Z src/ci/scripts/install-ninja.sh
2019-10-25T15:16:07.1157018Z /d/a/_temp
2019-10-25T15:16:07.1165936Z 2019-10-25T15:16:07.1244631Z ========================== Starting Command Output ===========================
2019-10-25T15:16:07.1245362Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/d71c3f75-7d4f-4ec9-aa17-323d43910292.sh
---
2019-10-25T15:16:07.8111592Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-25T15:16:07.8111695Z ==============================================================================
2019-10-25T15:16:08.0401327Z Generating script.
2019-10-25T15:16:08.0433904Z Script contents:
2019-10-25T15:16:08.0434210Z src/ci/scripts/enable-docker-ipv6.sh
2019-10-25T15:16:08.0749602Z /d/a/_temp
2019-10-25T15:16:08.0760333Z 2019-10-25T15:16:08.0796999Z ========================== Starting Command Output ===========================
2019-10-25T15:16:08.0801808Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/9d77bba8-ef86-4a21-8729-4db62e5c5f80.sh
---
2019-10-25T15:16:08.8088534Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/cdd5d9a0-1836-4264-ae78-00a3cfc8d845.sh
2019-10-25T15:16:08.9560796Z + set -o errexit
2019-10-25T15:16:08.9561028Z + set -o pipefail
2019-10-25T15:16:08.9561474Z + set -o nounset
2019-10-25T15:16:08.9705892Z +++ dirname /d/a/1/s/src/ci/scripts/../init_repo.sh
2019-10-25T15:16:08.9885070Z ++ cd /d/a/1/s/src/ci/scripts/..
2019-10-25T15:16:08.9931916Z + ci_dir=/d/a/1/s/src/ci
2019-10-25T15:16:08.9933862Z + . /d/a/1/s/src/ci/shared.sh
2019-10-25T15:16:08.9934229Z ++ export MIRRORS_BASE=https://rust-lang-ci-mirrors.s3-us-west-1.amazonaws.com/rustc
2019-10-25T15:16:08.9934229Z ++ export MIRRORS_BASE=https://rust-lang-ci-mirrors.s3-us-west-1.amazonaws.com/rustc
2019-10-25T15:16:08.9934526Z ++ MIRRORS_BASE=https://rust-lang-ci-mirrors.s3-us-west-1.amazonaws.com/rustc
2019-10-25T15:16:08.9934916Z + CACHE_DIR=/c/cache/rustsrc
2019-10-25T15:16:08.9935129Z + cache_src_dir=/c/cache/rustsrc/src
2019-10-25T15:16:08.9935315Z + '[' '!' -d . -o '!' -d ./.git ']'
2019-10-25T15:16:08.9935511Z + cd .
---
2019-10-25T16:01:52.5249561Z Finished release [optimized] target(s) in 27m 48s
2019-10-25T16:01:52.5899056Z Copying stage0 rustc from stage0 (x86_64-pc-windows-msvc -> x86_64-pc-windows-msvc / x86_64-pc-windows-msvc)
2019-10-25T16:01:52.6360875Z [TIMING] Rustc { target: "x86_64-pc-windows-msvc", compiler: Compiler { stage: 0, host: "x86_64-pc-windows-msvc" } } -- 1668.555
2019-10-25T16:01:52.6366751Z Building LLVM for x86_64-pc-windows-msvc
2019-10-25T16:01:52.6443468Z running: "cmake" "D:\\a\\1\\s\\src/llvm-project/llvm" "-G" "Ninja" "-DLLVM_ENABLE_ASSERTIONS=OFF" "-DLLVM_TARGETS_TO_BUILD=AArch64;ARM;Hexagon;MSP430;Mips;NVPTX;PowerPC;RISCV;Sparc;SystemZ;WebAssembly;X86" "-DLLVM_EXPERIMENTAL_TARGETS_TO_BUILD=" "-DLLVM_INCLUDE_EXAMPLES=OFF" "-DLLVM_INCLUDE_TESTS=OFF" "-DLLVM_INCLUDE_DOCS=OFF" "-DLLVM_INCLUDE_BENCHMARKS=OFF" "-DLLVM_ENABLE_ZLIB=OFF" "-DWITH_POLLY=OFF" "-DLLVM_ENABLE_TERMINFO=OFF" "-DLLVM_ENABLE_LIBEDIT=OFF" "-DLLVM_ENABLE_BINDINGS=OFF" "-DLLVM_ENABLE_Z3_SOLVER=OFF" "-DLLVM_PARALLEL_COMPILE_JOBS=2" "-DLLVM_TARGET_ARCH=x86_64" "-DLLVM_DEFAULT_TARGET_TRIPLE=x86_64-pc-windows-msvc" "-DLLVM_USE_CRT_DEBUG=MT" "-DLLVM_USE_CRT_RELEASE=MT" "-DLLVM_USE_CRT_RELWITHDEBINFO=MT" "-DLLVM_ENABLE_LIBXML2=OFF" "-DLLVM_VERSION_SUFFIX=-rust-1.40.0-nightly" "-DPYTHON_EXECUTABLE=D:\\a\\msys2\\mingw64\\bin\\python2.7" "-DCMAKE_INSTALL_MESSAGE=LAZY" "-DCMAKE_C_COMPILER=D:/a/1/s/build/bootstrap/debug/sccache-plus-cl.exe" "-DCMAKE_CXX_COMPILER=D:/a/1/s/build/bootstrap/debug/sccache-plus-cl.exe" "-DCMAKE_C_FLAGS=/nologo /MT" "-DCMAKE_CXX_FLAGS=/nologo /MT" "-DCMAKE_INSTALL_PREFIX=D:\\a\\1\\s\\build\\x86_64-pc-windows-msvc\\llvm" "-DCMAKE_BUILD_TYPE=Release"
2019-10-25T16:01:54.2644061Z -- The CXX compiler identification is MSVC 19.16.27034.0
2019-10-25T16:01:54.8376379Z -- The ASM compiler identification is MSVC
2019-10-25T16:01:54.8383440Z -- Found assembler: D:/a/1/s/build/bootstrap/debug/sccache-plus-cl.exe
2019-10-25T16:01:54.8842918Z -- Check for working C compiler: D:/a/1/s/build/bootstrap/debug/sccache-plus-cl.exe
---
2019-10-25T17:53:00.3330708Z building `exe` installer with `iscc`
2019-10-25T17:55:04.7540633Z finished in 124.420
2019-10-25T17:55:04.8560321Z 2019-10-25T17:55:04.8561018Z 2019-10-25T17:55:04.8561431Z failed to execute command: "D:/a/1/s/wix/bin/wix\\bin/heat.exe" "dir" "rustc" "-nologo" "-gg" "-sfrag" "-srd" "-sreg" "-cg" "RustcGroup" "-dr" "Rustc" "-var" "var.RustcDir" "-out" "D:\\a\\1\\s\\build\\tmp/dist\\exe\\RustcGroup.wxs"
2019-10-25T17:55:04.8561635Z error: The system cannot find the file specified. (os error 2)
2019-10-25T17:55:04.8561734Z 2019-10-25T17:55:04.9521461Z failed to run: D:\a\1\s\build\bootstrap\debug\bootstrap dist
2019-10-25T17:55:04.9521690Z Build completed unsuccessfully in 2:33:52
2019-10-25T17:55:05.0125612Z == clock drift check ==
2019-10-25T17:55:05.0125612Z == clock drift check ==
2019-10-25T17:55:05.0720162Z local time: Fri Oct 25 17:55:05 CUT 2019
2019-10-25T17:55:05.6948847Z network time: Fri, 25 Oct 2019 17:55:05 GMT
2019-10-25T17:55:05.6965201Z == end clock drift check ==
2019-10-25T17:55:05.7363352Z 2019-10-25T17:55:06.1903191Z ##[error]Bash exited with code '1'.
2019-10-25T17:55:06.2239276Z ##[section]Starting: Upload CPU usage statistics
2019-10-25T17:55:06.3225851Z ==============================================================================
2019-10-25T17:55:06.3226005Z Task : Bash
2019-10-25T17:55:06.3226087Z Description : Run a Bash script on macOS, Linux, or Windows

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

bors · 2019-10-25T18:16:21Z

💔 Test failed - checks-azure

emilyalbini · 2019-10-28T09:04:49Z

@bors r=alexcrichton p=10 rollup=never

bors · 2019-10-28T09:04:50Z

📌 Commit c854c44 has been approved by alexcrichton

bors · 2019-10-28T10:57:32Z

⌛ Testing commit c854c44 with merge a124dd93bef3b80f7934c36172e7f0fae01eca25...

bors · 2019-10-28T13:41:09Z

💔 Test failed - checks-azure

rust-highfive · 2019-10-28T13:41:09Z

The job dist-x86_64-mingw of your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2019-10-28T10:58:53.3644995Z do so (now or later) by using -b with the checkout command again. Example:
2019-10-28T10:58:53.3645609Z 2019-10-28T10:58:53.3646085Z git checkout -b <new-branch-name>
2019-10-28T10:58:53.3646231Z 2019-10-28T10:58:53.3646415Z HEAD is now at a124dd93b Auto merge of #65202 - pietroalbini:scriptify-ci-config, r=alexcrichton
2019-10-28T10:58:53.4070837Z ##[section]Starting: Collect CPU-usage statistics in the background
2019-10-28T10:58:53.4176409Z ==============================================================================
2019-10-28T10:58:53.4176496Z Task : Bash
2019-10-28T10:58:53.4176736Z Description : Run a Bash script on macOS, Linux, or Windows
---
2019-10-28T10:58:53.7773535Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T10:58:53.7773618Z ==============================================================================
2019-10-28T10:58:54.0197235Z Generating script.
2019-10-28T10:58:54.0302580Z Script contents:
2019-10-28T10:58:54.0302787Z src/ci/scripts/dump-environment.sh
2019-10-28T10:58:54.0697933Z /d/a/_temp
2019-10-28T10:58:54.0738652Z 2019-10-28T10:58:54.0769211Z ========================== Starting Command Output ===========================
2019-10-28T10:58:54.0775054Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/c9f50773-d644-4b9a-92ef-93e5dcc3d1e8.sh
---
2019-10-28T10:58:54.3284505Z 2019-10-28T10:58:54.3285085Z 2019-10-28T10:58:54.3285814Z 2019-10-28T10:58:54.3286262Z 2019-10-28T10:58:54.3286498Z * Being able to prepare the build environment locally by just running `src/ci/prepare.py` simplifies a lot setting up a local VM similar to CI (software pre-installed in the CI images won't be prepared, but it's a start anyway).
2019-10-28T10:58:54.3335102Z ##[warning]'* Extracted CI-specific behavior (like issuing `##vso[` commands and detecting the host platform) into `shared.sh` and included it in most of the scripts. This way a switch to another CI provider will be less painful.' contains logging command keyword '##vso', but it's not a legal command. Please see the list of accepted commands: https://go.microsoft.com/fwlink/?LinkId=817296
2019-10-28T10:58:54.3346400Z * Extracted CI-specific behavior (like issuing `##vso[` commands and detecting the host platform) into `shared.sh` and included it in most of the scripts. This way a switch to another CI provider will be less painful.
2019-10-28T10:58:54.3346731Z * Mirrored all the remaining external URLs we download (except chocolatey) to the `rust-lang-ci-mirrors` bucket, to increase reliability and reduce the chance of supply chain attacks. I didn't audit and mirror the CI scripts outside this PR though.
2019-10-28T10:58:54.3346952Z * When we'll switch to GitHub Actions we'll need to either duplicate code in multiple workflows or write a preprocessor. Having all the prepare steps in a single one is going to simplify the implementation of both options.
2019-10-28T10:58:54.3347172Z AGENT_DISABLELOGPLUGIN_TESTFILEPUBLISHERPLUGIN=true
2019-10-28T10:58:54.3347270Z AGENT_DISABLELOGPLUGIN_TESTRESULTLOGPLUGIN=true
2019-10-28T10:58:54.3347342Z AGENT_HOMEDIRECTORY=C:\agents\2.159.2
2019-10-28T10:58:54.3347424Z AGENT_ID=515
---
2019-10-28T10:58:54.3354185Z BUILD_SOURCEBRANCHNAME=auto
2019-10-28T10:58:54.3354266Z BUILD_SOURCESDIRECTORY=D:\a\1\s
2019-10-28T10:58:54.3354345Z BUILD_SOURCEVERSION=a124dd93bef3b80f7934c36172e7f0fae01eca25
2019-10-28T10:58:54.3354437Z BUILD_SOURCEVERSIONAUTHOR=bors
2019-10-28T10:58:54.3354528Z BUILD_SOURCEVERSIONMESSAGE=Auto merge of #65202 - pietroalbini:scriptify-ci-config, r=alexcrichton
2019-10-28T10:58:54.3354701Z COBERTURA_HOME=C:\cobertura-2.1.1
2019-10-28T10:58:54.3354795Z COMMONPROGRAMFILES=C:\Program Files\Common Files
2019-10-28T10:58:54.3354968Z COMMON_TESTRESULTSDIRECTORY=D:\a\1\TestResults
2019-10-28T10:58:54.3355053Z COMPUTERNAME=fv-az433
---
2019-10-28T10:58:54.3371077Z TMP=/tmp
2019-10-28T10:58:54.3371185Z TOOLSTATE_ISSUES_API_URL=https://api.github.com/repos/rust-lang/rust/issues
2019-10-28T10:58:54.3371290Z TOOLSTATE_PUBLISH=1
2019-10-28T10:58:54.3371380Z TOOLSTATE_REPO=https://github.com/rust-lang-nursery/rust-toolstate
2019-10-28T10:58:54.3371492Z There are two reasons why we'd want to do this:
2019-10-28T10:58:54.3371969Z ##[warning]'This PR moves most of the configuration from the CI yamls into bash scripts, driven by a small Python script (which understands and emulates the two `##vso[` commands we use).' contains logging command keyword '##vso', but it's not a legal command. Please see the list of accepted commands: https://go.microsoft.com/fwlink/?LinkId=817296
2019-10-28T10:58:54.3372393Z This PR moves most of the configuration from the CI yamls into bash scripts, driven by a small Python script (which understands and emulates the two `##vso[` commands we use).
2019-10-28T10:58:54.3372926Z USERDOMAIN=fv-az433
2019-10-28T10:58:54.3372998Z USERDOMAIN_ROAMINGPROFILE=fv-az433
2019-10-28T10:58:54.3373083Z USERNAME=VssAdministrator
2019-10-28T10:58:54.3373148Z USERPROFILE=C:\Users\VssAdministrator
---
2019-10-28T10:58:54.3374050Z r? @alexcrichton
2019-10-28T10:58:54.3374107Z 2019-10-28T10:58:54.3374162Z disk usage:
2019-10-28T10:58:54.4098515Z Filesystem Size Used Avail Use% Mounted on
2019-10-28T10:58:54.4098817Z C:/Program Files/Git 256G 140G 117G 55% /
2019-10-28T10:58:54.4098974Z D: 14G 2.0G 13G 14% /d
2019-10-28T10:58:54.4108414Z biggest files in the working dir:
2019-10-28T10:58:55.9262850Z 155656 .
2019-10-28T10:58:55.9262993Z 78597 ./src
2019-10-28T10:58:55.9263088Z 76409 ./.git
---
2019-10-28T10:58:58.7384962Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T10:58:58.7385094Z ==============================================================================
2019-10-28T10:58:58.9664956Z Generating script.
2019-10-28T10:58:58.9770671Z Script contents:
2019-10-28T10:58:58.9770773Z src/ci/scripts/switch-xcode.sh
2019-10-28T10:58:59.0136617Z /d/a/_temp
2019-10-28T10:58:59.0174662Z 2019-10-28T10:58:59.0205134Z ========================== Starting Command Output ===========================
2019-10-28T10:58:59.0209537Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/bfc568de-fb69-419d-8ad5-fa973db80242.sh
---
2019-10-28T10:58:59.1294810Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T10:58:59.1294888Z ==============================================================================
2019-10-28T10:58:59.3622942Z Generating script.
2019-10-28T10:58:59.3729561Z Script contents:
2019-10-28T10:58:59.3730179Z src/ci/scripts/install-wix.sh
2019-10-28T10:58:59.4109014Z /d/a/_temp
2019-10-28T10:58:59.4148084Z 2019-10-28T10:58:59.4176037Z ========================== Starting Command Output ===========================
2019-10-28T10:58:59.4181034Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/1e23b2b2-2a86-42fc-8722-2c1376247b29.sh
---
2019-10-28T10:59:03.5118334Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2019-10-28T10:59:03.5144376Z 100 1935k 100 1935k 0 0 2982k 0 --:--:-- --:--:-- --:--:-- 2982k
2019-10-28T10:59:07.3076000Z 2019-10-28T10:59:07.3146485Z ##[section]Finishing: Install InnoSetup
2019-10-28T10:59:07.3165217Z ##[section]Starting: Ensure the build happens on C:\ instead of D:\
2019-10-28T10:59:07.3265338Z Task : Bash
2019-10-28T10:59:07.3265415Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-28T10:59:07.3265474Z Version : 3.159.3
2019-10-28T10:59:07.3265543Z Author : Microsoft Corporation
2019-10-28T10:59:07.3265543Z Author : Microsoft Corporation
2019-10-28T10:59:07.3265609Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T10:59:07.3265699Z ==============================================================================
2019-10-28T10:59:07.5432974Z Generating script.
2019-10-28T10:59:07.5561271Z Script contents:
2019-10-28T10:59:07.5561629Z src/ci/scripts/windows-symlink-build-dir.sh
2019-10-28T10:59:07.5943018Z /d/a/_temp
2019-10-28T10:59:07.5989056Z 2019-10-28T10:59:07.6017980Z ========================== Starting Command Output ===========================
2019-10-28T10:59:07.6023730Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/27a143b2-9f78-450f-b997-979e054357ce.sh
2019-10-28T10:59:07.6023730Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/27a143b2-9f78-450f-b997-979e054357ce.sh
2019-10-28T10:59:07.8163066Z Junction created for build <<===>> c:\MORE_SPACE
2019-10-28T10:59:07.8212732Z 2019-10-28T10:59:07.8285818Z ##[section]Finishing: Ensure the build happens on C:\ instead of D:\
2019-10-28T10:59:07.8448628Z ==============================================================================
2019-10-28T10:59:07.8448730Z Task : Bash
2019-10-28T10:59:07.8448796Z Description : Run a Bash script on macOS, Linux, or Windows
2019-10-28T10:59:07.8448890Z Version : 3.159.3
---
2019-10-28T10:59:08.2536255Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T10:59:08.2536339Z ==============================================================================
2019-10-28T10:59:08.4709249Z Generating script.
2019-10-28T10:59:08.4817832Z Script contents:
2019-10-28T10:59:08.4817929Z src/ci/scripts/install-msys2.sh
2019-10-28T10:59:08.5178025Z /d/a/_temp
2019-10-28T10:59:08.5217552Z 2019-10-28T10:59:08.5246900Z ========================== Starting Command Output ===========================
2019-10-28T10:59:08.5252556Z [command]"C:\Program Files\Git\bin\bash.exe" --noprofile --norc /d/a/_temp/0001657f-f67e-411f-bd73-948b01acc455.sh
---
2019-10-28T11:02:19.9894566Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T11:02:19.9894643Z ==============================================================================
2019-10-28T11:02:20.2200911Z Generating script.
2019-10-28T11:02:20.2217761Z Script contents:
2019-10-28T11:02:20.2217955Z src/ci/scripts/install-msys2-packages.sh
2019-10-28T11:02:20.2548551Z /d/a/_temp
2019-10-28T11:02:20.2568285Z 2019-10-28T11:02:20.2600917Z ========================== Starting Command Output ===========================
2019-10-28T11:02:20.2607756Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/6213d300-b426-445d-912d-67c2b1e388f3.sh
---
2019-10-28T11:03:33.0923919Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T11:03:33.0924022Z ==============================================================================
2019-10-28T11:03:33.3351401Z Generating script.
2019-10-28T11:03:33.3383301Z Script contents:
2019-10-28T11:03:33.3383447Z src/ci/scripts/install-ninja.sh
2019-10-28T11:03:33.3735131Z /d/a/_temp
2019-10-28T11:03:33.3755379Z 2019-10-28T11:03:33.3786925Z ========================== Starting Command Output ===========================
2019-10-28T11:03:33.3791858Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/ec9a77b2-b67e-4764-a03c-6786e88bd1f5.sh
---
2019-10-28T11:03:34.0335571Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/bash
2019-10-28T11:03:34.0335650Z ==============================================================================
2019-10-28T11:03:34.2644729Z Generating script.
2019-10-28T11:03:34.2678481Z Script contents:
2019-10-28T11:03:34.2678566Z src/ci/scripts/enable-docker-ipv6.sh
2019-10-28T11:03:34.6965457Z /d/a/_temp
2019-10-28T11:03:34.6981486Z 2019-10-28T11:03:34.7008777Z ========================== Starting Command Output ===========================
2019-10-28T11:03:34.7013238Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/e4c3fee8-cdb0-4d02-8c6a-199964b4d122.sh
---
2019-10-28T11:03:35.4483790Z [command]D:\a\msys2\usr\bin\bash.exe --noprofile --norc /d/a/_temp/4881e0b5-5480-48c2-9fb8-0a079b35e3a0.sh
2019-10-28T11:03:35.6110257Z + set -o errexit
2019-10-28T11:03:35.6111013Z + set -o pipefail
2019-10-28T11:03:35.6111338Z + set -o nounset
2019-10-28T11:03:35.6260836Z +++ dirname /d/a/1/s/src/ci/scripts/../init_repo.sh
2019-10-28T11:03:35.6444991Z ++ cd /d/a/1/s/src/ci/scripts/..
2019-10-28T11:03:35.6473964Z + ci_dir=/d/a/1/s/src/ci
2019-10-28T11:03:35.6474707Z + . /d/a/1/s/src/ci/shared.sh
2019-10-28T11:03:35.6476369Z ++ export MIRRORS_BASE=https://rust-lang-ci-mirrors.s3-us-west-1.amazonaws.com/rustc
2019-10-28T11:03:35.6476369Z ++ export MIRRORS_BASE=https://rust-lang-ci-mirrors.s3-us-west-1.amazonaws.com/rustc
2019-10-28T11:03:35.6476534Z ++ MIRRORS_BASE=https://rust-lang-ci-mirrors.s3-us-west-1.amazonaws.com/rustc
2019-10-28T11:03:35.6476694Z + CACHE_DIR=/c/cache/rustsrc
2019-10-28T11:03:35.6476806Z + cache_src_dir=/c/cache/rustsrc/src
2019-10-28T11:03:35.6476874Z + '[' '!' -d . -o '!' -d ./.git ']'
2019-10-28T11:03:35.6476953Z + cd .
---
2019-10-28T13:36:47.7152649Z building `exe` installer with `iscc`
2019-10-28T13:39:37.1769882Z finished in 169.461
2019-10-28T13:39:37.3092044Z 2019-10-28T13:39:37.3093080Z 2019-10-28T13:39:37.3093881Z failed to execute command: "D:/a/1/s/wix/bin/wix\\bin/heat.exe" "dir" "rustc" "-nologo" "-gg" "-sfrag" "-srd" "-sreg" "-cg" "RustcGroup" "-dr" "Rustc" "-var" "var.RustcDir" "-out" "D:\\a\\1\\s\\build\\tmp/dist\\exe\\RustcGroup.wxs"
2019-10-28T13:39:37.3094607Z error: The system cannot find the file specified. (os error 2)
2019-10-28T13:39:37.3096839Z 2019-10-28T13:39:37.4311735Z failed to run: D:\a\1\s\build\bootstrap\debug\bootstrap dist
2019-10-28T13:39:37.4312000Z Build completed unsuccessfully in 2:30:47
2019-10-28T13:39:37.4773131Z == clock drift check ==
2019-10-28T13:39:37.4773131Z == clock drift check ==
2019-10-28T13:39:37.5459391Z local time: Mon Oct 28 13:39:37 CUT 2019
2019-10-28T13:39:39.3415381Z network time: Mon, 28 Oct 2019 13:39:39 GMT
2019-10-28T13:39:39.3416300Z == end clock drift check ==
2019-10-28T13:39:39.4198789Z 2019-10-28T13:39:40.2846370Z ##[error]Bash exited with code '1'.
2019-10-28T13:39:40.3298569Z ##[section]Starting: Upload CPU usage statistics
2019-10-28T13:39:40.4177667Z ==============================================================================
2019-10-28T13:39:40.4177834Z Task : Bash
2019-10-28T13:39:40.4177909Z Description : Run a Bash script on macOS, Linux, or Windows

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

emilyalbini · 2019-10-28T14:10:34Z

@bors try

bors · 2019-10-28T14:10:47Z

⌛ Trying commit af5cc3d with merge 0a65fe3...

bors · 2019-10-28T16:58:26Z

☀️ Try build successful - checks-azure
Build commit: 0a65fe3 (0a65fe3fd1bb2b9c4491cb5daecdd9cccca9a8a2)

emilyalbini · 2019-10-28T17:03:53Z

@bors r=alexcrichton p=10 rollup=never

bors · 2019-10-28T17:03:55Z

📌 Commit 7e05123 has been approved by alexcrichton

bors · 2019-10-28T17:17:35Z

⌛ Testing commit 7e05123 with merge b497e18...

bors · 2019-10-28T20:59:30Z

☀️ Test successful - checks-azure
Approved by: alexcrichton
Pushing b497e18 to master...

emilyalbini · 2019-10-28T21:09:55Z

Finally 🎉

rust-highfive assigned alexcrichton Oct 8, 2019

rust-highfive added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Oct 8, 2019

fbstj reviewed Oct 8, 2019
View reviewed changes

Comment threadsrc/ci/scripts/install-wix.sh Outdated

bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Oct 10, 2019

emilyalbini mentioned this pull request Oct 10, 2019
Upload toolstates.json to rust-lang-ci2 #65274
Merged

bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Oct 13, 2019

bors added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Oct 13, 2019

bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Oct 14, 2019

bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Oct 14, 2019

emilyalbini added 4 commits October 25, 2019 16:47

ci: split install-msys2 step into two separate scripts
db00787

ci: fix installation condition for MinGW
19fdc5c
I mistakenly inverted the "variable is not set" check in bash.

ci: set MSYS_BITS environment variable for all windows builders
fe65c8e
A few dist builders lacked that variable, causing build failures.

ci: fix tidy
9c44ca2

emilyalbini force-pushed the scriptify-ci-config branch from d1bd1a6 to 9c44ca2Compare October 25, 2019 14:51

bors mentioned this pull request Oct 25, 2019
Rollup of 5 pull requests #65812
Closed

ci: fix execution condition for install-clang
c854c44

ci: fix wrong path for wix being set
7e05123

mati865 reviewed Oct 28, 2019
View reviewed changes

Comment threadsrc/ci/scripts/install-wix.sh Outdated

Mark-Simulacrum mentioned this pull request Nov 2, 2019
Compile hangs endlessly in LLVM in await-heavy code when ThinLTO is enabled #66036
Closed

taiki-e mentioned this pull request May 20, 2020
Start migrating CI to Github Actions tokio-rs/tokio#2531
Merged

tesuji mentioned this pull request Jan 7, 2021
Borrow Checker Paniced Upon Gifted Code #80767
Closed

Uh oh!

Uh oh!

Conversation

emilyalbini commented Oct 8, 2019

Uh oh!

rust-highfive commented Oct 8, 2019

Uh oh!

Uh oh!

alexcrichton commented Oct 10, 2019

Uh oh!

bors commented Oct 10, 2019

Uh oh!

emilyalbini commented Oct 10, 2019

Uh oh!

bors commented Oct 13, 2019

Uh oh!

bors commented Oct 13, 2019

Uh oh!

rust-highfive commented Oct 13, 2019

Uh oh!

kennytm commented Oct 13, 2019

Uh oh!

Centril commented Oct 13, 2019

Uh oh!

emilyalbini commented Oct 14, 2019

Uh oh!

bors commented Oct 14, 2019

Uh oh!

bors commented Oct 14, 2019

Uh oh!

rust-highfive commented Oct 14, 2019

Uh oh!

bors commented Oct 14, 2019

Uh oh!

emilyalbini commented Oct 25, 2019

Uh oh!

bors commented Oct 25, 2019

Uh oh!

rust-highfive commented Oct 25, 2019

Uh oh!

bors commented Oct 25, 2019

Uh oh!

emilyalbini commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

rust-highfive commented Oct 28, 2019

Uh oh!

emilyalbini commented Oct 28, 2019

Uh oh!

Uh oh!

bors commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

emilyalbini commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

bors commented Oct 28, 2019

Uh oh!

emilyalbini commented Oct 28, 2019

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants