Explain Spark architecture in detail
Senior Data Engineer Interview Questions
2,551 senior data engineer interview questions shared by candidates
query over some tables a difficult SQL that required joins, group-by clauses, and window functions very basic python coding. how would you design a service for shorting URLs
Interview questions were very simple. You would are they really hiring or what? What is difference between RDD, DF and DS in Spark? What are the benefits of spark over MR? What are transformations and actions? Difference between map and flatMap? The interview with VP was about team fit. The last interview also seemed like they wanted me to join so team lead explained how he will help me in my career progression in the team. However, I ended up not getting the offer. they scheduled all interviews in one go. They don't have clear process to follow. I had answered all my questions correctly. So, I was very hopeful. However, after a week, recruiter didn't show professionalism to send feedback and I sent couple of emails, then she called me saying that they need someone with more Scala exposure. I knew it was just an excuse as they very rarely asked Scala questions. It was more about chit chat rather than techincal. So, it turned out I wasted four hours of mine. One big time suggestion to them is that they should learn to create a process for hiring. If candidate was not good technically, they should stop at that point rather than wasting candidate's time.
Why are you leaving your current company?
Questions to gauge fundamentals in Spark
After briefly going over experience we jumped into coding exercise. N friends represented by (x,y,z) Which friend should host the party so that the overall distance is least. 2 ) parenthesis matching
2. Fetch the duplicated records from a dataset
Tree traversal, data modeling around warehouse, ETL approach to specific problem.
How much data did you managed ?
Viewing 2391 - 2400 interview questions