Reasoning questions include scenario based given 2 statements which of following is true(difficult), picture based( weight problem), one 'for' loop program question,jumbling characters problem, one % based problem. techical include one MR program to print files output based on month and find no of sundays in each month. couple of spark and kafka questions. mostly on rdd . nit sure what it is.
Why work in data engineering?
Spark basics,Hive analytical functions, window functions, pivoting columns
what are transformation and action you have used in spark
what is df vs ds what is spark architecture
Spark optimization techniques. Spark memory management.
There is two table. one is emp_details another is employee salary Find emp who has salary more than 8000 and who has worked in multiple project. 2. Find prime num. between 1 to 50 in Python/java. 3. Execution of spark job 4.Big-data-ques
spark,scala basic questions
First Round Experience He asked me 2 SQL Questions(Questions were based on Join and group byAlso asked to write same code in pyspark) and few basic spark questions like cache and persist, reparation and coalesc, RDD, Dataframe and dataset difference. I cleared first round and HR again scheduled second round Second Round: 2 SQL questions which was based on joins and union, union and union all difference, RDD vs Dataframe vs Dataset, Repartition and coalesce,Spark Architecture, Hive and other project related and basic questions. I cleared second round as well then HR scheduled next round which is HR round. HR round: Introduce yourself, What I know about Impetus, Why changing job and walked me through company info and CTC breakdown. She has some budget constraints or approval constraints so not sure why they called and conducted this whole process.
Very generic questions which do not have any specific or single answer like - how would you optimize a hive query? how would you optimize a spark job?
Viewing 1771 - 1780 interview questions