Skip to content

Clean out unused directories for extra disk space - #69252

Merged
bors merged 1 commit into
rust-lang:masterfrom
Mark-Simulacrum:disk-try
Feb 18, 2020
Merged

Clean out unused directories for extra disk space#69252
bors merged 1 commit into
rust-lang:masterfrom
Mark-Simulacrum:disk-try

Conversation

@Mark-Simulacrum

@Mark-SimulacrumMark-Simulacrum commented Feb 18, 2020

Copy link
Copy Markdown
Member

This cleans out some of the unused (but large) directories on our linux builders to hopefully allow them to complete without running out of disk space.

@Mark-Simulacrum

Copy link
Copy Markdown
MemberAuthor

@bors try

We know that we can hit the problem on a try build, I believe, so let's try that.

@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

⌛ Trying commit dd6e41c with merge 9e7396e...

bors added a commit that referenced this pull request Feb 18, 2020
Dump largest files on disk, not just in cwd.
This will try to debug the disk space issues we're seeing (and potentially
become the "fix" PR).
r? @ghost
@Mark-Simulacrum
Mark-Simulacrumforce-pushed the disk-try branch 2 times, most recently from 6027618 to 20f79b6CompareFebruary 18, 2020 00:58
@Mark-SimulacrumMark-Simulacrum changed the title Dump largest files on disk, not just in cwd.Clean out unused directories for extra disk spaceFeb 18, 2020
@rust-highfive

Copy link
Copy Markdown
Contributor

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.
2020-02-18T00:58:44.1191206Z ========================== Starting Command Output ===========================
2020-02-18T00:58:44.1193945Z [command]/bin/bash --noprofile --norc /home/vsts/work/_temp/b4018b75-9173-48e9-bcea-a382c75e6a5a.sh
2020-02-18T00:58:44.1193991Z 2020-02-18T00:58:44.1197953Z ##[section]Finishing: Disable git automatic line ending conversion
2020-02-18T00:58:44.1204847Z ##[section]Starting: Checkout rust-lang/rust@refs/pull/69252/merge to s
2020-02-18T00:58:44.1206451Z Task : Get sources
2020-02-18T00:58:44.1206485Z Description : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
2020-02-18T00:58:44.1206562Z Version : 1.0.0
2020-02-18T00:58:44.1206595Z Author : Microsoft
---
2020-02-18T00:58:46.4227405Z ##[command]git remote add origin https://github.com/rust-lang/rust
2020-02-18T00:58:46.4240471Z ##[command]git config gc.auto 0
2020-02-18T00:58:46.4242666Z ##[command]git config --get-all http.https://github.com/rust-lang/rust.extraheader
2020-02-18T00:58:46.4245472Z ##[command]git config --get-all http.proxy
2020-02-18T00:58:46.4251862Z ##[command]git -c http.extraheader="AUTHORIZATION: basic ***" fetch --force --tags --prune --progress --no-recurse-submodules --depth=2 origin +refs/heads/*:refs/remotes/origin/* +refs/pull/69252/merge:refs/remotes/pull/69252/merge

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

@rust-highfive

Copy link
Copy Markdown
Contributor

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.
2020-02-18T01:00:56.0092437Z ========================== Starting Command Output ===========================
2020-02-18T01:00:56.0095351Z [command]/bin/bash --noprofile --norc /home/vsts/work/_temp/1eec2dd7-002a-47aa-98cd-b0076075d7c4.sh
2020-02-18T01:00:56.0095402Z 2020-02-18T01:00:56.0098762Z ##[section]Finishing: Disable git automatic line ending conversion
2020-02-18T01:00:56.0104670Z ##[section]Starting: Checkout rust-lang/rust@refs/pull/69252/merge to s
2020-02-18T01:00:56.0106540Z Task : Get sources
2020-02-18T01:00:56.0106567Z Description : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
2020-02-18T01:00:56.0106594Z Version : 1.0.0
2020-02-18T01:00:56.0106630Z Author : Microsoft
---
2020-02-18T01:00:56.8542922Z ##[command]git remote add origin https://github.com/rust-lang/rust
2020-02-18T01:00:56.8631688Z ##[command]git config gc.auto 0
2020-02-18T01:00:56.8718144Z ##[command]git config --get-all http.https://github.com/rust-lang/rust.extraheader
2020-02-18T01:00:56.8769728Z ##[command]git config --get-all http.proxy
2020-02-18T01:00:56.8904634Z ##[command]git -c http.extraheader="AUTHORIZATION: basic ***" fetch --force --tags --prune --progress --no-recurse-submodules --depth=2 origin +refs/heads/*:refs/remotes/origin/* +refs/pull/69252/merge:refs/remotes/pull/69252/merge

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

@JohnTitor

Copy link
Copy Markdown
Member

Rubber-stamping
@bors r+ rollup

@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

📌 Commit 304d1a9 has been approved by JohnTitor

@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

🌲 The tree is currently closed for pull requests below priority 100, this pull request will be tested once the tree is reopened

@borsbors added the S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. label Feb 18, 2020
JohnTitor added a commit to JohnTitor/rust that referenced this pull request Feb 18, 2020
Clean out unused directories for extra disk space
This cleans out some of the unused (but large) directories on our linux builders to hopefully allow them to complete without running out of disk space.
@JohnTitorJohnTitor mentioned this pull request Feb 18, 2020
bors added a commit that referenced this pull request Feb 18, 2020
Rollup of 8 pull requests
Successful merges:
- #67272 (recursion_limit parsing handles overflows)
- #68597 (Simplify `Skip::nth` and `Skip::last` implementations)
- #68767 (macOS: avoid calling pthread_self() twice)
- #69175 (Do not ICE when encountering `yield` inside `async` block)
- #69223 (Ignore GDB versions with broken str printing.)
- #69244 (configure: set LLVM flags with a value)
- #69249 (Stabilize {f32, f64}::{LOG2_10, LOG10_2})
- #69252 (Clean out unused directories for extra disk space)
Failed merges:
r? @ghost
Comment threadsrc/ci/scripts/dump-environment.sh Outdated
This helps us have enough disk space for our builders to be able to complete
successfully. For now, the choices are ad-hoc and 'definitely not needed'. This
should never fail the build, as everything our build needs should be inside
Docker.
@emilyalbini

Copy link
Copy Markdown
Member

@bors r+ p=1000

@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

📌 Commit c992ab2 has been approved by pietroalbini

@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

🌲 The tree is currently closed for pull requests below priority 100, this pull request will be tested once the tree is reopened

@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

⌛ Testing commit c992ab2 with merge 2d1a6b42b8261195b845bc597fdf5f815ad76ca3...

JohnTitor added a commit to JohnTitor/rust that referenced this pull request Feb 18, 2020
…lbini
Clean out unused directories for extra disk space
This cleans out some of the unused (but large) directories on our linux builders to hopefully allow them to complete without running out of disk space.
@JohnTitorJohnTitor mentioned this pull request Feb 18, 2020
@JohnTitor

Copy link
Copy Markdown
Member

It works well, let's include this to rollup
@bors retry

bors added a commit that referenced this pull request Feb 18, 2020
Rollup of 8 pull requests
Successful merges:
- #67272 (recursion_limit parsing handles overflows)
- #68597 (Simplify `Skip::nth` and `Skip::last` implementations)
- #68767 (macOS: avoid calling pthread_self() twice)
- #69175 (Do not ICE when encountering `yield` inside `async` block)
- #69223 (Ignore GDB versions with broken str printing.)
- #69244 (configure: set LLVM flags with a value)
- #69249 (Stabilize {f32, f64}::{LOG2_10, LOG10_2})
- #69252 (Clean out unused directories for extra disk space)
Failed merges:
r? @ghost
@bors
bors merged commit c992ab2 into rust-lang:masterFeb 18, 2020
@bors

bors commented Feb 18, 2020

Copy link
Copy Markdown
Collaborator

⌛ Testing commit c992ab2 with merge 6317721...

@Mark-Simulacrum
Mark-Simulacrum deleted the disk-try branch February 23, 2020 02:31
@Mark-SimulacrumMark-Simulacrum added beta-accepted Accepted for backporting to the compiler in the beta channel. beta-nominated Nominated for backporting to the compiler in the beta channel. stable-accepted Accepted for backporting to the compiler in the stable channel. labels Feb 23, 2020
@Mark-SimulacrumMark-Simulacrum removed the beta-nominated Nominated for backporting to the compiler in the beta channel. label Feb 28, 2020
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

beta-acceptedAccepted for backporting to the compiler in the beta channel.S-waiting-on-borsStatus: Waiting on bors to run and complete tests. Bors will change the label on completion.stable-acceptedAccepted for backporting to the compiler in the stable channel.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@Mark-Simulacrum@bors@rust-highfive@JohnTitor@emilyalbini