The transaction manager is non ACID so I cannot obviously use ACID transactional operation here. I tried using "insert Overwrite" and it is only working on managed table not on external table.
Is there a possible way to do it from Pyspark?
PS: hive table gets loaded by a job in production.There are few rows which we need to update manually. And the table is stored in AWS S3