The WHERE clause does not support LIKE

[springrain]

CREATE VIRTUAL TABLE IF NOT EXISTS vec_document_chunk USING vec0(
     id TEXT,
    documentID TEXT,
    knowledgeBaseID TEXT,
    embedding float[1024],
    sortNo INT,
    status INT
);

SELECT rowid,distance as score,* FROM vec_document_chunk WHERE embedding MATCH ? and knowledgeBaseID like ? ORDER BY score LIMIT 5

An illegal WHERE constraint was provided on a vec0 metadata column in a KNN query. Only one of EQUALS, GREATER_THAN, LESS_THAN_OR_EQUAL, LESS_THAN, GREATER_THAN_OR_EQUAL, NOT_EQUALS is allowed.

[asg017]

Thanks for filing - yes LIKE isn't supported yet. Can I ask what pattern you're using in your example? If you're comparing exact IDs, you could also use knowledgeBaseID = ? if you're using an exact match.

Nonetheless, LIKE support requires some special handling, because the internal representation of text metadata stores the first 12 bytes of a string in an easy-to-access cache and the rest in a separate buffer. Would could easily support LIKE patterns that end with a wildcard, ex `name LIKE 'Ale%', but more complex patterns may be more difficult.

[springrain]

It can support LIKE patterns that end with a wildcard. Thank you very much.

Thanks for filing - yes LIKE isn't supported yet. Can I ask what pattern you're using in your example? If you're comparing exact IDs, you could also use knowledgeBaseID = ? if you're using an exact match.

Nonetheless, LIKE support requires some special handling, because the internal representation of text metadata stores the first 12 bytes of a string in an easy-to-access cache and the rest in a separate buffer. Would could easily support LIKE patterns that end with a wildcard, ex `name LIKE 'Ale%', but more complex patterns may be more difficult.

[springrain]

@asg017 Do you have a plan to implement like 'abc%' ?

[vlasky]

@springrain LIKE and GLOB have been implemented in my fork:

https://github.com/vlasky/sqlite-vec

These are the commits:

• vlasky@0dfec69
• vlasky@4899d0e

Hope these enhancements eventually make their way here.

[folke]

Would be really great if sqlite-vec would have support for prefix queries LIKE 'foo%'.

I'm using it for a document store, and having the possibility to filter on specific paths would be nice.

@vlasky maybe you should create a PR based on the work on your fork?