Senior Data Engineer Interview Questions

2,556 senior data engineer interview questions shared by candidates

A developer on the team was running the following line in a function for logging purposes, and the job crashed with an "out of memory" exception. The developer says that the cluster has many workers with a lot of memory and disk and still the job crashes. Can you help explain how come to this line makes the job crash with OOM even though the cluster is huge? def someFunc(): for row in df.collect(): print(f'Customerr{row["customer"]} => Paid {row["price"]}')
avatar

Senior Data Engineer

Interviewed at AppsFlyer

4.1
Mar 16, 2023

A developer on the team was running the following line in a function for logging purposes, and the job crashed with an "out of memory" exception. The developer says that the cluster has many workers with a lot of memory and disk and still the job crashes. Can you help explain how come to this line makes the job crash with OOM even though the cluster is huge? def someFunc(): for row in df.collect(): print(f'Customerr{row["customer"]} => Paid {row["price"]}')

Viewing 1841 - 1850 interview questions

See Interview Questions for Similar Jobs

Glassdoor has 2,556 interview questions and reports from Senior data engineer interviews. Prepare for your interview. Get hired. Love your job.