where are the individual dataproc spark logs?

Question

Welcome To Ask or Share your Answers For Others

where are the individual dataproc spark logs?

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

Where are the dataproc spark job logs located? I know there are logs from the driver under "Logging" section but what about the execution nodes? Also, where are the detailed steps that Spark is executing logged (I know I can see them in the Application Master)? I am attempting to debug a script that seems to hang and spark seems to freeze.

See Question&Answers more detail:os

与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…

682 views

1 Answer

深蓝 · Answer 1 · 2021-10-23T21:43:07+0000

answered Oct 24, 2021 by 深蓝 (71.8m points)

Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…

Categories

where are the individual dataproc spark logs?

Please log in or register to add a comment.

Please log in or register to answer this question.

1 Answer

Please log in or register to add a comment.

Just Browsing Browsing

Most popular tags