I am trying to build an express server that will receive http requests for potentially running multiple kafkajs consumers on demand (each consumer will listen to one particular topic only as each topic will have only one partition). I am trying to understand what limitations I might have with this setup if my server ends up managing several consumers receiving messages at a time (to specify, the express app will essentially be used for running / disconnecting these consumers).With my current knowledge I understand that using child processes / worker threads won't help me in scaling my application so I'm trying to get a better understanding of the restrictions involved.
↧