I would like to know it there is any other alternative to the spark-redshift connector. It seems it is not longer maintained since this library is automatically included in the Databricks cluster images for Spark 2.1.0-db2 and later versions.
1 Answer
There is no current alternative with equivalent functionality - the closest available is through usage of the Postgres JDBC driver. See this thread for information on usage. Unfortunately, great features such as full query pushdown are exclusive to the closed-source Databricks implementation right now.