Skip to content
BranchesTags

Latest commit

History

131 Commits

Folders and files

NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h

Repository files navigation

BodyTrack / Fluxtream / ESDR Datastore

Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.

Goals:

  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail

Installing on OS X

Install boost using e.g. macports:

sudo port install boost

Build and install

make
make test
make install-local

Installing on Ubuntu

Please install boost using apt-get (TODO(rsargent): verify this)

sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install

make
make test
make install-local

Installing on Windows

Install cygwin and ensure the following packages get installed:

make
gcc-g++
libcurl-devel

Build and install

make
make test
make install-local

Importing sparse data

JSON representation of data for import includes a dense array of timestamped rows:

"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample being added for that particular channel at that particular time:

[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a particular time. So if you write a new value at a time that already has a value, you'll overwrite the old value with the new.

Deleting data samples

It's possible to delete samples when you overwrite. If you want to delete individual samples (or, overwrite with "no sample" so to speak), you can use false in JSON import for the values you wish to delete:

[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:

Note: FFT support is unfinished, so this documentation isn't right, yet:

To install with optional FFT support via the NFFTv3 library, which is under the GPLv2 license:

Download and install NFFT, version 3 (as of the time of this writing, NFFT 3.2.2 was the most recent version, and is also the version which was used for testing during development. You might try a newer version if it's available):

wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in to NFFT support, add FFT_SUPPORT=1 to the make command line (the Makefile compiles with FFT support whenever FFT_SUPPORT is set to a non-empty string). In other words, replace "make target" with "make target FFT_SUPPORT=1" for whichever choice of target you would have used normally. For example, instead of "make test", execute

make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier transform by running

./gettile

If the help message contains a sentence mentioning the DFT or Fourier transform, such as "If the string '.DFT' is appended to the channel name, the discrete Fourier transform of the data is returned instead," then of course your binaries have been compiled with FFT support.

About

BodyTrack datastore. C++ project for handling and serving data streams.

Resources

Readme
Activity
Custom properties

Stars

8 stars

Watchers

2 watching

Forks

14 forks
Report repository

Releases

Packages

Contributors

Languages

, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all 
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Force GitHub README to respect dark mode
(function() {
var style = document.createElement('style');
style.textContent = '
.markdown-body {
color-scheme: dark light;
}
.markdown-body pre { background: #161b22 !important; }
.markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }
.markdown-body table th, .markdown-body table td { border-color: #30363d !important; }
.markdown-body img { background: #0d1117; }
.markdown-body blockquote { border-left-color: #8b949e; }
.markdown-body hr { border-color: #30363d; }
';
document.head.appendChild(style);
})();
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Highlight search terms from Google/DuckDuckGo/Bing referrer
(function() {
var ref = document.referrer;
var terms = [];
if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {
var url = new URL(ref);
var q = url.searchParams.get('q') || url.searchParams.get('p');
if (q) {
terms = q.split(/\s+/).filter(function(t) { return t.length > 2; });
}
}
if (terms.length === 0) return;
var style = document.createElement('style');
style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';
document.head.appendChild(style);
function highlight(node) {
if (node.nodeType === 3) { // text node
var text = node.textContent;
var found = false;
terms.forEach(function(term) {
var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi');
if (regex.test(text)) {
found = true;
var frag = document.createDocumentFragment();
var parts = text.split(regex);
parts.forEach(function(part, i) {
if (i % 2 === 0) {
frag.appendChild(document.createTextNode(part));
} else {
var span = document.createElement('span');
span.className = 'userscript-highlight';
span.textContent = part;
frag.appendChild(span);
}
});
node.parentNode.replaceChild(frag, node);
}
});
} else if (node.nodeType === 1 && node.childNodes) { // element
var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];
if (!skipTags.includes(node.tagName)) {
Array.from(node.childNodes).forEach(highlight);
}
}
}
highlight(document.body);
// Re-highlight on dynamic content
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1 || node.nodeType === 3) highlight(node);
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Strip utm_, fbclid, gclid, etc. from all links on page
(function() {
var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',
'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',
'ref', 'ref_src', 'source', 'medium', 'campaign'];
function cleanUrl(url) {
try {
var u = new URL(url, window.location.origin);
var changed = false;
trackingParams.forEach(function(p) {
if (u.searchParams.has(p)) {
u.searchParams.delete(p);
changed = true;
}
});
return changed ? u.toString() : url;
} catch (e) {
return url;
}
}
function cleanLinks() {
document.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
cleanLinks();
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1) {
if (node.tagName === 'A') cleanLinks();
node.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Auto-enable theater mode on YouTube
(function() {
function tryTheater() {
var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]');
if (btn && !btn.classList.contains('activated')) {
btn.click();
}
}
// Try immediately
tryTheater();
// Try after navigation (SPA)
var lastUrl = location.href;
setInterval(function() {
if (location.href !== lastUrl) {
lastUrl = location.href;
setTimeout(tryTheater, 500);
}
}, 1000);
// Also try on player load
var observer = new MutationObserver(tryTheater);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Remove or un-stick sticky/fixed headers that block content
(function() {
function unstick() {
document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) {
if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {
el.style.position = 'static';
el.style.top = 'auto';
el.style.zIndex = 'auto';
}
});
}
unstick();
var observer = new MutationObserver(unstick);
observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });
})();
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages

, 'i');
if (__m === '*' || __re.test(location.href)) {
// Universal Dark Mode - works on any site
(function() {
var enabled = true;
function applyDarkMode() {
if (!enabled) return;
// Create style element if it doesn't exist
var style = document.getElementById('universal-dark-mode-style');
if (!style) {
style = document.createElement('style');
style.id = 'universal-dark-mode-style';
document.head.appendChild(style);
}
// Dark mode CSS - inverts colors but preserves images/video
style.textContent = '
/* Invert everything except media */
html {
filter: invert(1) hue-rotate(180deg) !important;
background: #1a1a2e !important;
}
/* Restore images, videos, iframes, canvas */
img, video, iframe, canvas, svg, picture, [style*="background-image"] {
filter: invert(1) hue-rotate(180deg) !important;
}
/* Preserve specific elements that should not be inverted */
.no-dark-mode, .no-dark-mode *,
[data-theme="light"], [data-theme="light"],
.ace_editor, .ace_editor *,
.CodeMirror, .CodeMirror *,
.monaco-editor, .monaco-editor *,
.markdown-body pre, .markdown-body pre *,
.highlight, .highlight *,
pre code, pre code * {
filter: none !important;
}
/* Fix common UI elements */
.modal, .popup, .dropdown-menu, .tooltip, .popover {
filter: invert(1) hue-rotate(180deg) !important;
background: #2d2d44 !important;
border-color: #444 !important;
}
/* Scrollbars */
::-webkit-scrollbar { background: #1a1a2e !important; }
::-webkit-scrollbar-thumb { background: #444 !important; }
::-webkit-scrollbar-thumb:hover { background: #555 !important; }
/* Selection */
::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }
';
}
function removeDarkMode() {
var style = document.getElementById('universal-dark-mode-style');
if (style) style.remove();
}
// Toggle with Alt+Shift+D
document.addEventListener('keydown', function(e) {
if (e.altKey && e.shiftKey && e.key === 'D') {
e.preventDefault();
enabled = !enabled;
if (enabled) {
applyDarkMode();
console.log('[Universal Dark Mode] Enabled');
} else {
removeDarkMode();
console.log('[Universal Dark Mode] Disabled');
}
}
});
// Apply on load
applyDarkMode();
// Re-apply on dynamic content
var observer = new MutationObserver(function(mutations) {
if (enabled && !document.getElementById('universal-dark-mode-style')) {
applyDarkMode();
}
});
observer.observe(document.head, { childList: true });
console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');
})();
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();
GitHub - BodyTrack/datastore: BodyTrack datastore. C++ project for handling and serving data streams. · GitHub
Skip to content
BranchesTags
Latest commit
History
131 Commits
Folders and files
NameName
Last commit message
Last commit date
.idea
.idea
date @ cc4685a
date @ cc4685a
jsoncpp-src-0.5.0-patched
jsoncpp-src-0.5.0-patched
magic
magic
test
test
.gitignore
.gitignore
.gitmodules
.gitmodules
Arglist.h
Arglist.h
BUILD.txt
BUILD.txt
BinaryIO.cpp
BinaryIO.cpp
BinaryIO.h
BinaryIO.h
Binrec.cpp
Binrec.cpp
Binrec.h
Binrec.h
Channel.cpp
Channel.cpp
Channel.h
Channel.h
ChannelInfo.h
ChannelInfo.h
DataSample.h
DataSample.h
Doxyfile
Doxyfile
FileBlock.cpp
FileBlock.cpp
FileBlock.h
FileBlock.h
FilesystemKVS.cpp
FilesystemKVS.cpp
FilesystemKVS.h
FilesystemKVS.h
ImportBT.cpp
ImportBT.cpp
ImportBT.h
ImportBT.h
ImportJson.cpp
ImportJson.cpp
ImportJson.h
ImportJson.h
KVS.cpp
KVS.cpp
KVS.h
KVS.h
Log.cpp
Log.cpp
Log.h
Log.h
Makefile
Makefile
MappedFile.cpp
MappedFile.cpp
MappedFile.h
MappedFile.h
NOTES.txt
NOTES.txt
Parse.h
Parse.h
README-CPB.txt
README-CPB.txt
README.md
README.md
Range.h
Range.h
TODO.txt
TODO.txt
TestFileBlock.cpp
TestFileBlock.cpp
Tile.cpp
Tile.cpp
Tile.h
Tile.h
TileIndex.h
TileIndex.h
copy.cpp
copy.cpp
crc32.cpp
crc32.cpp
crc32.h
crc32.h
export.cpp
export.cpp
fft.cpp
fft.cpp
fft.h
fft.h
gettile.cpp
gettile.cpp
import.cpp
import.cpp
info.cpp
info.cpp
mysql.h
mysql.h
mysql_common.cpp
mysql_common.cpp
mysql_common.h
mysql_common.h
simple_shared_ptr.h
simple_shared_ptr.h
sizes.h
sizes.h
test-anne
test-anne
tilegen.cpp
tilegen.cpp
utils.cpp
utils.cpp
utils.h
utils.h
Repository files navigation
BodyTrack / Fluxtream / ESDR Datastore
Efficiently handle high volumes of numeric and text time series, with precomputed level-of-detail summarizations.
Goals:
  • Fast to write samples or sequences of samples
  • Fast to read time-bounded sequences of samples at requested level of detail
Installing on OS X
Install boost using e.g. macports:
sudo port install boost

Build and install
make
make test
make install-local

Installing on Ubuntu
Please install boost using apt-get (TODO(rsargent): verify this)
sudo apt-get install libboost-dev libboost-doc
sudo apt-get install libboost-thread

Build and install
make
make test
make install-local

Installing on Windows
Install cygwin and ensure the following packages get installed:
make
gcc-g++
libcurl-devel

Build and install
make
make test
make install-local

Importing sparse data
JSON representation of data for import includes a dense array of timestamped rows:
"channel_names": ["latitude", "longitude", "accuracy", "bearing", "provider", "speed"],
"data": [
[1312774909.76562, 32.8465, -117.27, 0, 0, "network", 1],
[1312774910.76562, 32.9013, -117.265, 0, 0, "network", 2],
[1312774911.76562, 32.8982, -117.252, 0, 0, "network", 3]
],

You can use null for sparse data. This will result in no sample
being added for that particular channel at that particular time:
[1312774910.76562, null, null, 0, 0, "network", 2]

Datastore will only hold one value for a device.channel at a
particular time. So if you write a new value at a time that already
has a value, you'll overwrite the old value with the new.
Deleting data samples
It's possible to delete samples when you overwrite. If you want to
delete individual samples (or, overwrite with "no sample" so to
speak), you can use false in JSON import for the values you wish to
delete:
[1312774909.76562, false, false, false, "speedometer", 4]

FFT support:
Note: FFT support is unfinished, so this documentation isn't right, yet:
To install with optional FFT support via the NFFTv3 library, which
is under the GPLv2 license:
Download and install NFFT, version 3 (as of the time of this writing,
NFFT 3.2.2 was the most recent version, and is also the version which
was used for testing during development. You might try a newer version
if it's available):
wget http://www-user.tu-chemnitz.de/~potts/nfft/download/nfft-3.2.2.tar.gz
tar xvzf nfft-3.2.2.tar.gz
cd nfft-3.2.2
./configure
make
sudo make install
cd ..
rm -r nfft-3.2.2 nfft-3.2.2.tar.gz

This should install the NFFT library on your system. Then, to opt in
to NFFT support, add FFT_SUPPORT=1 to the make command line
(the Makefile compiles with FFT support whenever FFT_SUPPORT is set to
a non-empty string). In other words, replace "make target" with
"make target FFT_SUPPORT=1" for whichever choice of target you would
have used normally. For example, instead of "make test", execute
make test FFT_SUPPORT=1

You will know that your freshly built binaries support the Fourier
transform by running
./gettile

If the help message contains a sentence mentioning the DFT or Fourier
transform, such as "If the string '.DFT' is appended to the channel name,
the discrete Fourier transform of the data is returned instead,"
then of course your binaries have been compiled with FFT support.
About
BodyTrack datastore. C++ project for handling and serving data streams.
Resources
Readme
Activity
Custom properties
Stars
8 stars
Watchers
2 watching
Forks
14 forks
Report repository
Releases
Packages
Contributors
Languages