Skip to content

Python bindings pq flash #12

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Harsha Simhadri (harsha-simhadri) wants to merge 37 commits into from
Closed

Python bindings pq flash #12

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
f09e6e0
Vamana Python Bindings
ShikharJ Feb 1, 2021
5ae530c
AVX-512 support and Improved Optimized Search
ShikharJ Feb 3, 2021
91a624b
Add Support for Inner Product Metric
ShikharJ Feb 11, 2021
939de10
Add support for zero vectors
ShikharJ Feb 16, 2021
a6160a7
Fix Aligned Dimension Instruction
ShikharJ Feb 17, 2021
0d91a56
Refactor L2 Distance for Non-Zero Vector Traversal
ShikharJ Feb 27, 2021
36b542c
Add multi-threaded search support for Python bindings
ShikharJ Mar 6, 2021
49560ec
Add PQ Compression Support for Vamana
ShikharJ Mar 15, 2021
2d32142
Update Paths in Python Tests
ShikharJ May 2, 2021
f73a0b0
remove comments
harsha-simhadri May 25, 2021
4ecc22e
setup.py file changed, diskann_bindings added
harsha-simhadri Jun 4, 2021
efc9a0a
added pybind for diskann search
harsha-simhadri Jun 8, 2021
ae2071c
added build code to python bindings
harsha-simhadri Jun 30, 2021
f1ea75e
libaio link in pybind works
harsha-simhadri Jul 7, 2021
3c65044
added build code to python bindings
harsha-simhadri Jul 11, 2021
7c0cd60
created diskann wrapper class in pybind to avoid shared_ptr deallocation
harsha-simhadri Jul 12, 2021
59eebe0
bug fix in python test search disk index
harsha-simhadri Jul 12, 2021
79d93f6
bug fix in python test search disk index
harsha-simhadri Jul 12, 2021
97e9c46
working test search disk index pybind
suhasjs Jul 13, 2021
03151f0
python interface test build disk index
harsha-simhadri Jul 29, 2021
cdcf508
fixes to batch query mode
harsha-simhadri Jul 30, 2021
59a8467
batch search works, but with 1 thread
harsha-simhadri Jul 30, 2021
6a3011b
added num_thread arg to load function in diskann bindings
harsha-simhadri Jul 30, 2021
b76581f
added num_thread arg to load function in diskann bindings
harsha-simhadri Jul 30, 2021
ea2376b
remove gil lock/unlock
harsha-simhadri Jul 30, 2021
f7fe1d9
add omp get max threads to python wrapper
harsha-simhadri Aug 3, 2021
bfd3f08
added param names to build function in python wrapper
harsha-simhadri Aug 3, 2021
3f045a6
added return value for index_load success
harsha-simhadri Aug 3, 2021
dd75524
search and batch search API with py::array query
harsha-simhadri Aug 5, 2021
b232eaf
added a test file for numpy interface search
harsha-simhadri Aug 5, 2021
0440668
calculate recall with numpy results input
harsha-simhadri Aug 5, 2021
29c3caf
calculate recall with numpy results input
harsha-simhadri Aug 5, 2021
80374e3
tested numpy interface to batch query
harsha-simhadri Aug 5, 2021
534c6f6
query np array accessed via non-mutable interface
harsha-simhadri Aug 6, 2021
8b8b31a
reshape numpy interface output to {nq,knn}
harsha-simhadri Aug 6, 2021
cc63fe9
moved diskann bindings methods to a teampled c++ class
harsha-simhadri Aug 10, 2021
2a83592
added int8 and unit8 index interface
harsha-simhadri Aug 10, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ else()
# set(CMAKE_CXX_FLAGS_DEBUG "${CMAKE_CXX_FLAGS_DEBUG} -g -DDEBUG -O0 -fsanitize=address -fsanitize=leak -fsanitize=undefined")
set(CMAKE_CXX_FLAGS_DEBUG "${CMAKE_CXX_FLAGS_DEBUG} -g -DDEBUG -Wall -Wextra")
set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELEASE} -Ofast -DNDEBUG -march=native -mtune=native -ftree-vectorize")
add_compile_options(-march=native -Wall -fno-builtin-malloc -fno-builtin-calloc -fno-builtin-realloc -fno-builtin-free -fopenmp -fopenmp-simd -funroll-loops -Wfatal-errors -DUSE_ACCELERATED_PQ -DUSE_AVX2)
add_compile_options(-march=native -Wall -fno-builtin-malloc -fno-builtin-calloc -fno-builtin-realloc -fno-builtin-free -fopenmp -fopenmp-simd -funroll-loops -Wfatal-errors -DUSE_ACCELERATED_PQ -fPIC)
endif()

add_subdirectory(src)
Expand Down
Loading