0

The transaction manager is non ACID so I cannot obviously use ACID transactional operation here. I tried using "insert Overwrite" and it is only working on managed table not on external table.

Is there a possible way to do it from Pyspark?

PS: hive table gets loaded by a job in production.There are few rows which we need to update manually. And the table is stored in AWS S3

2
  • As per my understanding, you can do insert overwrite for external tables, What error/issue are facing when trying to insert overwrite external tables
    – Vijiy
    Feb 21, 2019 at 14:00
  • @Vijiy AWS S3 access denied Feb 21, 2019 at 14:30

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.