Ramzy

Ramzy has asked 1 questions and find answers to 20 problems.

Stats

About

Lead Hadoop Engineer

Ramzy questions

How to tune spark executor number, cores and executor memory?

Ramzy answers

How hashing works in bucketing for hive?
How to limit the number of reduce jobs in mapreduce java code in hadoop
Monitoring Apache Spark Logs and the Dynamic App/Driver logs
Spark + Yarn: How to retain logs of lost-executors
Spark Streaming - Restarting from checkpoint replays last batch
Hbase Java API Example
How can we decide the total no. of buckets for a hive table
Rows with identical keys
hadoop 2.4.0 streaming generic parser options using TAB as separator
Pyspark read multiple csv files into a dataframe (OR RDD?)