Implementing delayed message support with Apache Kafka
15 Jul 2024What if you want to put a message in Kafka and want to consume it after some time, without stopping your consumer or polling and re-pushing again and again?
What if you want to put a message in Kafka and want to consume it after some time, without stopping your consumer or polling and re-pushing again and again?
Sometimes, you might observe your program breaching all thresholds and taking up more memory than required. You might observe sawtooth patterns in your memory charts. This is a sign of classic Memory Leak, which eventually leads to OOM.
AWS Nitro Enclaves enables customers to create isolated compute environments to further protect and securely process highly sensitive data such as personally identifiable information (PII), healthcare, financial, and intellectual property data within their Amazon EC2 instances. - Official Docs
AWS ECS provides CPU and Memory metrics out of the box and these can be used for creating scaling policies.
Posted here.
Goroutines are lightweight; have a small stack (2KB, from v1.4) and a fast context switch.