I tried googling for this but all I got were stories about minor celebrities. Given the lack of documentation, what is a DList?
4 Answers
It's a Difference List, along the lines of "Difference List as functions"
scala> val (l1, l2, l3) = (List(1, 2, 3), List(4, 5, 6), List(7, 8, 9))
l1: List[Int] = List(1, 2, 3)
l2: List[Int] = List(4, 5, 6)
l3: List[Int] = List(7, 8, 9)
Efficient prepending:
scala> l1 ::: l2 ::: l3
res8: List[Int] = List(1, 2, 3, 4, 5, 6, 7, 8, 9)
Inefficient appending. This creates an intermediate list (l1 ++ l2), then ((l1 ++ l2) ++ l3)
scala> l1 ++ l2 ++ l3 // inefficient
res9: List[Int] = List(1, 2, 3, 4, 5, 6, 7, 8, 9)
DList
stores up the appends, and only needs to create one complete list, effectively invoking:
scala> List(l1, l2, l3) reduceRight ( _ ::: _)
res10: List[Int] = List(1, 2, 3, 4, 5, 6, 7, 8, 9)
-
Isn't prepending regular Scala lists with ::: still linear in the length of the prefixes? Or is there some additional code that exploits their immutability to do better? Jul 28, 2010 at 16:16
-
6With a
DList
, the total operation is stillO(n * m)
, wheren
is number of chunks andm
is the chunk size. With++
, the operation isO(n * n * m)
– retronymJul 28, 2010 at 16:53
Difference lists are a list-like data structure that supports O(1) append operations.
Append, and other operations that modify a list are represented via function composition of the modification functions, rather than directly copying the list.
An example, from Haskell's dlist library:
-- Lists as functions
newtype DList a = DL { unDL :: [a] -> [a] }
-- The empty list
empty = DL id
-- The append case: composition, a la Hughes
append xs ys = DL (unDL xs . unDL ys)
-- Converting to a regular list, linear time.
toList = ($[]) . unDL
The technique goes back at least to Hughes 84, A novel representation of lists and its application to the function "reverse", R. John Hughes, 1984., where, he proposes representing lists as functions, and append as function composition, allowing e.g. reverse to run in linear time. From the paper:
-
It would be good to add an
a -> DList a
example:singleton = \a -> DL ((:) a)
– palikNov 21, 2019 at 20:14
It's a data type in the non-canonical scalaz package, useful for typed lists with constant-time access at both ends. (The trick is to google for "scala" AND "dlist".)
-
-
DList were found to overflow the stack and were deleted from Scalaz: code.google.com/p/scalaz/issues/detail?id=19 Apr 6, 2012 at 0:05
-
@WillSargent DList was added back to Scalaz in 2011 github.com/scalaz/scalaz/commit/… Sep 5, 2013 at 23:52
From the project page of scalaz:
DList, a data type for representing elements of the same type with constant time append/prepend operations.