I have been running the node_exporter version 0.8.0 for a while now. Maybe 2 weeks, and I am now seeing a pretty high IO load. If I run iotop then I am seeing it reading megabytes of data in a matter of seconds. It is basically using 99% of the io on the system.
If I run lsof -p $PID then I see that there are a lot of open file descriptors to /pro/stat and /proc/$PID/limits and /proc/meminfo and /proc/$PID/stat
if this helps
sudo lsof -p 25359 | awk '{print $9}' | sort | uniq -c | sort -n
1 *:7301
1 /dev/null
1 /proc/diskstats
1 /tmp/node_exporter.ip-XXXX.root.log.INFO.20150501-131008.25359
1 /usr/lib64/ld-2.19.so
1 /usr/lib64/libc-2.19.so
1 /usr/lib64/libnss_files-2.19.so
1 /usr/lib64/libpthread-2.19.so
1 /var/lib/prometheus/node_exporter
1 NAME
1 anon_inode
1 ip-XXXX.compute.internal:7301->ip-XXXX.compute.internal:49115
2 /
2 /proc/25359/mounts
2 /proc/25359/net/dev
2 socket
12 /proc/25359/limits
17 /proc/stat
19 /proc/25359/stat
20 /proc/meminfo
47 can't identify protocol
I have been running the node_exporter version 0.8.0 for a while now. Maybe 2 weeks, and I am now seeing a pretty high IO load. If I run iotop then I am seeing it reading megabytes of data in a matter of seconds. It is basically using 99% of the io on the system.
If I run lsof -p $PID then I see that there are a lot of open file descriptors to /pro/stat and /proc/$PID/limits and /proc/meminfo and /proc/$PID/stat
if this helps
sudo lsof -p 25359 | awk '{print $9}' | sort | uniq -c | sort -n