Stateless operators
- branch
- filter
- inverseFilter
- flatMap
- flatMapValues
- foreach
- groupByKey
- groupBy
- map
- mapValues
Stateful operators
- join
- aggregate
- count
- reduce
- windowing
Window
- Tumbling window
- Time based, Fixed Size, Non overlapping, Gap less windows
- For e.g. if window-size=5min and advance-interval =5min then it looks like [0-5min] [5min-10min] [10min-15min].....
- Hopping window
- Time based, Fixed Size, Overlapping windows
- For e.g. if widow-size=5min and advance-interval=3min then it looks like [0-5min] [3min-8min] [6min-11min]......
- Sliding window
- Fixed size overlapping window that works on the difference between record timestamp
- Used only for join operation
- Session window
- Session based, Dynamically sized, Non overlapping, Data driven window.
- Used to aggregate key based events into session.
For more information on windowing, refer Apache Kafka Documentation
Hi Ashish, Where can I get more details and examples of these four window functions ?
ReplyDeletehttps://kafka.apache.org/20/documentation/streams/developer-guide/dsl-api.html#windowing
DeleteI am finding it hard to get my head around session windows. Wondering if there is any good article that explains the concept with real world use cases?
ReplyDeleteDo you realize there's a 12 word sentence you can communicate to your crush... that will induce deep emotions of love and instinctual attractiveness for you buried within his heart?
ReplyDeleteBecause hidden in these 12 words is a "secret signal" that triggers a man's instinct to love, look after and protect you with his entire heart...
=====> 12 Words That Fuel A Man's Desire Impulse
This instinct is so hardwired into a man's mind that it will make him work better than before to make your relationship the best part of both of your lives.
In fact, fueling this mighty instinct is so binding to getting the best ever relationship with your man that once you send your man a "Secret Signal"...
...You will soon find him expose his heart and mind to you in such a way he never experienced before and he'll recognize you as the one and only woman in the galaxy who has ever truly fascinated him.