I have used sc.broadcast
for lookup files to improve the performance.
I also came to know there is a function called broadcast
in Spark SQL Functions.
What is the difference between two?
Which one i should use it for broadcasting the reference/look up tables?
See Question&Answers more detail:os