Handling 5000 API Calls per Second in a Financial/Trading App – Seeking High Performance Solution

manish_rana_32f31dc0b2078

Manish Rana

Posted on October 22, 2024

Handling 5000 API Calls per Second in a Financial/Trading App – Seeking High Performance Solution

I am working on a Node.js-based financial/trading app where the system needs to handle scenarios like placing 5000 API calls in a second. These can be the same or different APIs. I want to process all these requests in parallel with a high response time and low latency.

What would be the best approach for optimizing Node.js to handle such a high volume of parallel API calls? I'm looking for a solution that ensures low latency and fast responses. Any guidance or suggestions would be highly appreciated

Here’s what I’ve tried so far:

Implemented Node.js clustering to leverage all CPU cores. Used worker threads for parallel task execution. Conducted load testing using Artillery at 500-1000 requests per second (RPS). Despite these efforts, I'm facing issues with timeouts and high response times, particularly under load.

💖 💪 🙅 🚩
manish_rana_32f31dc0b2078
Manish Rana

Posted on October 22, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related

What was your win this week?
weeklyretro What was your win this week?

November 29, 2024

Where GitOps Meets ClickOps
devops Where GitOps Meets ClickOps

November 29, 2024

How to Use KitOps with MLflow
beginners How to Use KitOps with MLflow

November 29, 2024

Modern C++ for LeetCode 🧑‍💻🚀
leetcode Modern C++ for LeetCode 🧑‍💻🚀

November 29, 2024