femibyte

femibyte has asked 22 questions and find answers to 5 problems.

Stats

About

Python & Java and now Scala are my first loves for programming. Working with Big Data & Cloud technologies - AWS, Kafka, Spark, Hadoop ecosystem.

femibyte questions

Object not serializable error on org.apache.avro.generic.GenericData$Record
Memory Usage of sc.textfile vs sc.wholeTextFiles + flatMapValues
Using java Map in scala
Error starting pyspark with options (Without Spack packages)
Functions vs function pointers
multiprocessing module and distinct psycopg2 connections
Setting spark.speculation in Spark 2.1.0 while writing to s3
Pausing Dataproc cluster - Google Compute engine
How to call unique() on dask DataFrame
dask DataFrame equivalent of pandas DataFrame sort_values

femibyte answers

Error starting pyspark with options (Without Spack packages)
Calculate the running time for spark sql
multiprocessing module and distinct psycopg2 connections