Welcome to ShenZhenJia Knowledge Sharing Community for programmer and developer-Open, Learning and Share
menu search
person
Welcome To Ask or Share your Answers For Others

Categories

Is there any standard Scala class/Object to create a simple connection with oracle database (using JDBC) but without loading a specific table ? I just want to create a simple connection then pass some query (create/update, etc.) and finally close the connection.

i have seen a code like :

val jdbcDF = spark.read
  .format("jdbc")
  .option("url", "jdbc:postgresql:dbserver")
  .option("dbtable", "schema.tablename")
  .option("user", "username")
  .option("password", "password")
  .load()

But it loads a specific table as mentionned in .option("dbtable", "schema.tablename").


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
thumb_up_alt 0 like thumb_down_alt 0 dislike
3.0k views
Welcome To Ask or Share your Answers For Others

1 Answer

Here are all the JDBC examples. 'write' creates the table automatically, no need to explicitly create the table, if table already behavior depends on "mode" like overwrite, append, error, no-op.

If you want to update the table like delete selected rows via spark you could create a new DF with desired rows only and write it in overwrite mode, as suggested here


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
thumb_up_alt 0 like thumb_down_alt 0 dislike
Welcome to ShenZhenJia Knowledge Sharing Community for programmer and developer-Open, Learning and Share
...