Uh oh!
There was an error while loading. Please reload this page.
Fix plays indexing starvation - #11361
Conversation
|
| # ####### CELERY TASKS ####### # | ||
| @celery.task(name="index_payment_router", time_limit=300, bind=True) | ||
| @celery.task(name="index_payment_router", rate_limit="5/s", time_limit=300, bind=True) |
There was a problem hiding this comment.
cool i've not seen this setting before
dylanjeffers
left a comment
There was a problem hiding this comment.
is that 5 seconds or half a second?
isaacsolo
commented
Feb 13, 2025
5 tries per second |
[3932be3] entity manager through core on dev (#11359) alecsavvy [e8eb855] fix lint (#11362) alecsavvy [42944f4] Fix plays indexing starvation (#11361) Isaac Solo [9fa5f75] Revert "filter chain health on these nodes" (#11358) alecsavvy [e85347a] [C-5763C-5603] Migrate profile collections to tan-query (#11285) Dylan Jeffers [48ba8aa] [C-5767] Migrate related-artists to tan-query #2 (#11303) Dylan Jeffers
* origin/main: (21 commits) Test listen streak challenge 2 listens in 1 day (#11373) Listen streak challenge fix 2 plays in one day (#11372) Randomize storage node ordering in StorageNodeSelector. (#11371) Disable endless listen streak challenge, delete rows (#11369) Fix user-link overflow (#11370) MRVR country fixes (#11118) [C-5270C-5269C-5268C-5629] Comment layout improvements (#11360) 🪦 poa ganache (#11367) Fix playlist invalid sort test (#11368) core block diff health check (#11365) Audius Protocol v0.7.90 Hide endless challenge audio (#11364) [C-5769] Use batch fetching to normalize core entity hooks (#11355) entity manager through core on dev (#11359) fix lint (#11362) Fix plays indexing starvation (#11361) Revert "filter chain health on these nodes" (#11358) Tag audiusd with protocol releases to allow reverts (#11347) [C-5763C-5603] Migrate profile collections to tan-query (#11285) [C-5767] Migrate related-artists to tan-query #2 (#11303) ...
…ibles * origin/main: (71 commits) [PAY-3881][PAY-3883] Add indexing/endpoints for separated collectibles data (#11287) [C5778] Update web profile page layout (#11374) Test listen streak challenge 2 listens in 1 day (#11373) Listen streak challenge fix 2 plays in one day (#11372) Randomize storage node ordering in StorageNodeSelector. (#11371) Disable endless listen streak challenge, delete rows (#11369) Fix user-link overflow (#11370) MRVR country fixes (#11118) [C-5270C-5269C-5268C-5629] Comment layout improvements (#11360) 🪦 poa ganache (#11367) Fix playlist invalid sort test (#11368) core block diff health check (#11365) Audius Protocol v0.7.90 Hide endless challenge audio (#11364) [C-5769] Use batch fetching to normalize core entity hooks (#11355) entity manager through core on dev (#11359) fix lint (#11362) Fix plays indexing starvation (#11361) Revert "filter chain health on these nodes" (#11358) Tag audiusd with protocol releases to allow reverts (#11347) ...
Description
Rewards manager indexing is negatively impacting plays indexing. Moving it to index_sol queue and adding rate limits will help better control fairness between these tasks. I believe before when i tried to simply move and keep that countdown, other tasks were still building up in the queue faster. Increasing concurrency to match the task number. Running on prod dn2 right now and allowed plays to catch up and keep solana indexing < 1 sec.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide repro instructions & any configuration.