invoke_model_with_bidirectional_stream high CPU usage

[cfaherty]

Hi. I am evaluating Nova Sonic and wanted to ask if there is a known issue with high CPU usage and invoke_model_with_bidirectional_stream. As if spinning on a read.

I ask this because our EC2 instance running Python 3.12 or 3.13 seems CPU 50-100% versus the nodejs sample which is never higher than 5% CPU usage.

Forgive me for the anecdotal nature of this issue. I'm pretty deep in investigating this issue in our codebase and just had to ask whether I am hitting a known issue since I know this is pre-release.

Thanks.

[yourappleintelligence]

Hi @cfaherty I’m also currently trying to evaluate Nova Sonic using Python, and I’m running into issues installing dependencies.

I keep getting errors when trying to install aws_sdk_bedrock_runtime — specifically:

ERROR: No matching distribution found for aws_sdk_bedrock_runtime

Because of this, I’m not sure whether I should be using boto3 or the aws_sdk_bedrock_runtime package (which I can’t seem to install at all). I noticed you’re using Python — may I ask: are you using boto3, or have you somehow managed to get aws_sdk_bedrock_runtime working?

and if you used aws_sdk_bedrock_runtime can help me how. can I use it as package the installation in this example its self : https://github.com/aws-samples/amazon-nova-samples

Any tips would be greatly appreciated! Thanks!

[tokarev-artem]

@yourappleintelligence python3.12 required

[juanmhidalgo]

We are experiencing the same issue. When using invoke_model_with_bidirectional_stream, CPU usage consistently spikes to around 95%. Additionally, when more than one client connects, both clients start experiencing noticeable audio issues.

[cfaherty]

ERROR: No matching distribution found for aws_sdk_bedrock_runtime

The distribution is either aws-sdk-bedrock-runtime (with dashes) or aws_sdk_bedrock_runtime (with underlines). I honestly cannot remember which.

[prettyprettyprettygood]

@cfaherty @juanmhidalgo it sounds like you have websocket implementation. Can you share how you handle the front end and the back end?

[jonathan343]

Hey everyone,

The high CPU usage issues have been resolved in aws-sdk-bedrock-runtime v0.1.1 with today's release!!
If you're still on versions < 0.1.0, I'd recommend looking at the following release announcements to help address any breaking changes (they're very minor). Otherwise, there are no changes needed when going from v0.1.0 to v0.1.1.:

• Smithy Python v0.1.0 Release
• AWS SDK for Python v0.1.0 Release

We appreciate your patience and apologize for the delay in addressing this issue.

We would love to hear any feedback you have about the change! I'll close this issue at the end of the week if there is no activity. Thanks!

[jonathan343]

Closing. Thanks again for reporting this issue!