Skip to content

TESTING: what is taking disk space - #18143

Closed
alamb wants to merge 8 commits into
apache:branch-50from
alamb:alamb/find_space_taker
Closed

TESTING: what is taking disk space#18143
alamb wants to merge 8 commits into
apache:branch-50from
alamb:alamb/find_space_taker

Conversation

@alamb

Copy link
Copy Markdown
Contributor

Related to

We are trying to figure out what is taking disk space. This PR is an attempt to gather telemetry and test

I don't intend to merge this

@alambalamb changed the title Alamb/find space takerTESTING: what is taking disk spaceOct 17, 2025
@github-actionsgithub-actionsBot added the development-process Related to development process of DataFusion label Oct 17, 2025
@comphead

Copy link
Copy Markdown
Contributor

looks like the image become larger, and it contains lots of things we dont need. like different Pythons, codeQL, etc

@comphead

comphead commented Oct 17, 2025

Copy link
Copy Markdown
Contributor
Disk space before cleanup:
Filesystem Size Used Avail Use% Mounted on
overlay 72G 54G 19G 75% /
tmpfs 64M 0 64M 0% /dev
shm 64M 0 64M 0% /dev/shm
/dev/root 72G 54G 19G 75% /__w
tmpfs 3.2G 1.2M 3.2G 1% /run/docker.sock
tmpfs 7.9G 0 7.9G 0% /proc/acpi
tmpfs 7.9G 0 7.9G 0% /proc/scsi
tmpfs 7.9G 0 7.9G 0% /sys/firmware
742M	/__t/node
1.6G	/__t/CodeQL
520M	/__t/PyPy
24K	/__t/Java_Temurin-Hotspot_jdk
1.5G	/__t/Python
1.1G	/__t/go
218M	/__t/Ruby
5.5G	/__t
170M	/__e/node20
214M	/__e/node24
99M	/__e/node20_alpine
130M	/__e/node24_alpine
611M	/__e
92K	/__w/_temp
953M	/__w/datafusion
16K	/__w/_PipelineMapping
14M	/__w/_actions
966M	/__w
Disk space after cleanup:
Filesystem Size Used Avail Use% Mounted on
overlay 72G 49G 23G 69% /
tmpfs 64M 0 64M 0% /dev
shm 64M 0 64M 0% /dev/shm
/dev/root 72G 49G 23G 69% /__w
tmpfs 3.2G 1.2M 3.2G 1% /run/docker.sock
tmpfs 7.9G 0 7.9G 0% /proc/acpi
tmpfs 7.9G 0 7.9G 0% /proc/scsi
tmpfs 7.9G 0 7.9G 0% /sys/firmware

Saved 4G it might be enough

@comphead

Copy link
Copy Markdown
Contributor

We are good here, I'll polish my PR and we can go ahead

@alamb

Copy link
Copy Markdown
ContributorAuthor

Thanks for the help @comphead

@alambalamb closed this Oct 18, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-processRelated to development process of DataFusion

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@alamb@comphead