Hadoop Developer Interview Questions

329 hadoop developer interview questions shared by candidates

Interviewer started to ask questions based on what i have kept in resume. His questions started from basic to advanced. What is bucketing and partitioning and use cases? Difference between group and co group in Pig ? Day to day activities in my job? Project flow ? Accumulators and broad cast variables in spark? How spark is fault tolerant? Distributed cache in hadoop? What types of fileformats used in hive? Default mappers in sqoop? How much of data you handle daily or monthly? Why hive and pig used? On Map reduce basic programming? like how you will write program just to test your knowledge on MapReduce. If you store file from HDFS to pig using PIGSTORAGE in grunt shell but if that file is not actually available in that HDFS path will it work?
avatar

Hadoop Developer

Interviewed at Infosys

3.6
Dec 14, 2017

Interviewer started to ask questions based on what i have kept in resume. His questions started from basic to advanced. What is bucketing and partitioning and use cases? Difference between group and co group in Pig ? Day to day activities in my job? Project flow ? Accumulators and broad cast variables in spark? How spark is fault tolerant? Distributed cache in hadoop? What types of fileformats used in hive? Default mappers in sqoop? How much of data you handle daily or monthly? Why hive and pig used? On Map reduce basic programming? like how you will write program just to test your knowledge on MapReduce. If you store file from HDFS to pig using PIGSTORAGE in grunt shell but if that file is not actually available in that HDFS path will it work?

Spark: Optimization techniques How do you determine the Spark-Submit options What are the critical issues/failure you recently faced and how did you resolve How to assure the fault tolarance Kafka: What is the cluster size What is ISR How do you assure exactly-once delivery (message) What is the importance of Zookeeper in Kafka Streaming: What is backpressure and what is the use of it How to recover from a failure
avatar

Hadoop Lead

Interviewed at HCLTech

3.5
Sep 22, 2019

Spark: Optimization techniques How do you determine the Spark-Submit options What are the critical issues/failure you recently faced and how did you resolve How to assure the fault tolarance Kafka: What is the cluster size What is ISR How do you assure exactly-once delivery (message) What is the importance of Zookeeper in Kafka Streaming: What is backpressure and what is the use of it How to recover from a failure

Viewing 181 - 190 interview questions

Glassdoor has 329 interview questions and reports from Hadoop developer interviews. Prepare for your interview. Get hired. Love your job.