Skip to content

Add langchain standard integration tests - #5

Open
cbornet wants to merge 1 commit into
mainfrom
standard-tests
Open

Add langchain standard integration tests#5
cbornet wants to merge 1 commit into
mainfrom
standard-tests

Conversation

@cbornet

Copy link
Copy Markdown
Collaborator

No description provided.

@cbornet
cbornetforce-pushed the standard-tests branch 5 times, most recently from 2adca13 to 89fcebcCompareAugust 7, 2025 10:07
@cbornet
cbornetforce-pushed the standard-tests branch 4 times, most recently from 0810afa to 6b2a922CompareAugust 14, 2025 17:03
@cbornet
cbornetforce-pushed the standard-tests branch 2 times, most recently from 5edc0b3 to d865eddCompareAugust 14, 2025 17:10
raise RuntimeError(msg)

time.sleep(1)
docs = retriever.invoke(

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should keep the retries

Copy link
Copy Markdown
CollaboratorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to have the retries in the setup (in the pipeline_id fixture).
Is there a possibility that retrieving docs fails after it has succeeded once ?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, in that case it's a different issue and we should fail

Copy link
Copy Markdown
CollaboratorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What issue could arise ?
I find it not stable to have an API succeed on one call, then fail on the next one...

Copy link
Copy Markdown
CollaboratorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also the goal of this PR is to add the LangChain integration tests and these don't do retries.

Copy link
Copy Markdown
CollaboratorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to have the retries in the setup (in the pipeline_id fixture).

Note that the retries in the fixture are not on the pipeline creation request but on a doc retrieval request, similar to the one that will be done in the tests just afterwards.

@cbornet
cbornetforce-pushed the standard-tests branch 2 times, most recently from 26ba852 to 9d22c08CompareAugust 19, 2025 08:41
@cbornet
cbornetforce-pushed the standard-tests branch 2 times, most recently from ff7c4ef to bbcb61bCompareSeptember 1, 2025 17:53
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@cbornet@nicoloboschi