A dynamic professional with experience in IoT, M2M and predictive analytics domain with big data analytics for real time & batch data processing.

✔ Expertise in development with SparkSQL, Spark Streaming, Hive, Sqoop, Impala, Hbase, MapReduce, Kafka

✔ Expertise in debugging & resolving spark & hive issues for large datasets

✔ Expertise in optimisation of spark jobs (sql & streaming) and hive queries

✔ Expertise in scala, python and java development for spark and aws use cases along with unit testing

✔ Expertise in hadoop, hive security in cloudera distribution

✔ Capable of designing end to end big data pipeline according to business needs

✔ Capable of designing architecture and deploying solution on AWS (CloudFormation, S3, ECS, ELB, VPC)

✔ Expertise in NoSQL(habse, cassandra), RDBMS(postgres, mysql) and In-memory DB (redis)

✔ Expertise in data visualisation tools like PowerBI, Datameer

✔ Capable of managing deliverable and leading team

✔ Capable of transforming business requirement into technical problem and designing a solution

✔ Experience in agile methodology projects and able to work in strict timelines

✔ Capable of performing R&D among various big data tools in different areas (data processing, data storage, data visualisation)

✔ Ability to handle multiple projects in parallel

✔ Experience of working with multiple clients listed in Fortune 500.