You can use json_normalize
:
from pandas.io.json import json_normalize
df = json_normalize(ds, ['subGroups'], 'name').rename(columns={0:'subGroupsFlattend'})
print (df)
subGroupsFlattend name
0 123 groupA
1 456 groupA
2 aaa groupB
3 bbb groupB
4 ccc groupB
Alternative solution with flattening dictionaries:
L = [y for x in ds for y in zip(x["subGroups"], [x["name"]] * len(x["subGroups"]))]
print (L)
[(123, 'groupA'), (456, 'groupA'), ('aaa', 'groupB'), ('bbb', 'groupB'), ('ccc', 'groupB')]
df = pd.DataFrame(L, columns=['subGroupsFlattend','name'])
print (df)
subGroupsFlattend name
0 123 groupA
1 456 groupA
2 aaa groupB
3 bbb groupB
4 ccc groupB
EDIT:
from itertools import chain
df = pd.DataFrame(ds)
df1 = pd.DataFrame({
'subGroups' : list(chain.from_iterable(df['subGroups'].tolist())),
'name' : df['name'].values.repeat(df['subGroups'].str.len())
})
print (df1)
name subGroups
0 groupA 123
1 groupA 456
2 groupB aaa
3 groupB bbb
4 groupB ccc