I am a data engineer. I am here to upskill myself and help the community with whatever I learn.
I am active on -> pandas
, python
and sometimes on pyspark
tags.
Some of my favorite answers (WIP):
PySpark:
- create a table with spark.catalog.createTable
- How do I find the most frequent element in a list in pyspark?
- How to Transpose multiple columns in a Dataframe
- PySpark - Split Array Column into smaller chunks