[Spark] Streaming Graceful Shutdown
How to do graceful shutdown of spark streaming job / sigkill, sigterm, sigint 차이
Posted by
Wonyong Jang
on April 19, 2021 ·
9 mins read
[Spark] Streaming Data Sources
Kafka, Kinesis / Direct, Receiver Based Data Sources, Fault Tolerance / Backpressure
Posted by
Wonyong Jang
on April 15, 2021 ·
7 mins read
[Spark] 아파치 스파크(spark) RDD 여러가지 연산
지연 처리 방식의 Transformation, 즉시 실행 방식의 Action / narrow, wide transformation
Posted by
Wonyong Jang
on April 12, 2021 ·
22 mins read
[Spark] 아파치 스파크(spark) 시작하기
Driver, Executor, Node, Job, Stage, Task, Cluster Manager/ RDD, Fault tolerance / Hadoop
Posted by
Wonyong Jang
on April 11, 2021 ·
16 mins read
[DB] MongoDB Index 설계 전략
인덱스 설계와 성능 향상 방법 / 쿼리 상태 점검(currentOp) 및 종료(killOp)
Posted by
Wonyong Jang
on April 06, 2021 ·
27 mins read
[Scala] Null, null, Nil, Nothing, None, and Unit
Empty value을 표현하는 방법과 사용 목적
Posted by
Wonyong Jang
on March 31, 2021 ·
2 mins read