Why Hadoop? ( Compare to RDBMS) ... What would happen if NameNode failed? How do you bring it up? ... What details are in the “fsimage” file? ... What is SecondaryNameNode? ... Explain the MapReduce processing framework? (start to end) ... What is Combiner? ... What is Partitioner? ... Oozie – What are the nodes?
Step by step implementation of a data pipeline.
Q: Spark Architecture, how is it different and what are pros and cons?
Explain ETL Process in detail, which tool have you used?
Discuss experience and how it relates to the position
how do you keep yourself updated in the world of data engineering
The interview assignment was related to build a data pipeline using whatever means thought appropriate. There were also a number of items / questions around improving upon and product ionizing the process.
What would you do at Octave to ensure a scalable architecture?
How much are you expecting?
In L1 for data engineer profile in gcp , questions are pretty simple. You must to have a normal understating of python, oops concept and data structure like dict tuple list etc
Viewing 1721 - 1730 interview questions