586

If I have an array like this in Bash:

FOO=( a b c )

How do I join the elements with commas? For example, producing a,b,c.

34 Answers 34

777

A 100% pure Bash function that supports multi-character delimiters is:

function join_by {
  local d=${1-} f=${2-}
  if shift 2; then
    printf %s "$f" "${@/#/$d}"
  fi
}

For example,

join_by , a b c #a,b,c
join_by ' , ' a b c #a , b , c
join_by ')|(' a b c #a)|(b)|(c
join_by ' %s ' a b c #a %s b %s c
join_by $'\n' a b c #a<newline>b<newline>c
join_by - a b c #a-b-c
join_by '\' a b c #a\b\c
join_by '-n' '-e' '-E' '-n' #-e-n-E-n-n
join_by , #
join_by , a #a

The code above is based on the ideas by @gniourf_gniourf, @AdamKatz, @MattCowell, and @x-yuri. It works with options errexit (set -e) and nounset (set -u).

Alternatively, a simpler function that supports only a single character delimiter, would be:

function join_by { local IFS="$1"; shift; echo "$*"; }

For example,

join_by , a "b c" d #a,b c,d
join_by / var local tmp #var/local/tmp
join_by , "${FOO[@]}" #a,b,c

This solution is based on Pascal Pilz's original suggestion.

A detailed explanation of the solutions previously proposed here can be found in "How to join() array elements in a bash script", an article by meleu at dev.to.

31
  • 11
    Use this for multicharacter separators: function join { perl -e '$s = shift @ARGV; print join($s, @ARGV);' "$@"; } join ', ' a b c # a, b, c Jun 19, 2014 at 15:06
  • 5
    @dpatru anyway to make that pure bash? Jul 4, 2014 at 0:54
  • 5
    @puchu What doesn't work is multi-character separators. To say "space doesn't work" makes it sound like joining with a space doesn't work. It does.
    – Eric
    Oct 7, 2015 at 18:20
  • 8
    This promotes spawning subshells if storing output to variable. Use konsolebox style :) function join { local IFS=$1; __="${*:2}"; } or function join { IFS=$1 eval '__="${*:2}"'; }. Then use __ after. Yes, I'm the one promoting use of __ as a result variable ;) (and a common iteration variable or temporary variable). If the concept gets to a popular Bash wiki site, they copied me :)
    – konsolebox
    Nov 5, 2015 at 19:43
  • 7
    Don't put the expansion $d in the format specifier of printf. You think you're safe since you “escaped” the % but there are other caveats: when the delimiter contains a backslash (e.g., \n) or when the delimiter starts with a hyphen (and maybe others I can't think of now). You can of course fix these (replace backslashes by double backslashes and use printf -- "$d%s"), but at some point you'll feel that you're fighting against the shell instead of working with it. That's why, in my answer below, I prepended the delimiter to the terms to be joined. Feb 3, 2016 at 17:06
289

Yet another solution:

#!/bin/bash
foo=('foo bar' 'foo baz' 'bar baz')
bar=$(printf ",%s" "${foo[@]}")
bar=${bar:1}

echo $bar

Edit: same but for multi-character variable length separator:

#!/bin/bash
separator=")|(" # e.g. constructing regex, pray it does not contain %s
foo=('foo bar' 'foo baz' 'bar baz')
regex="$( printf "${separator}%s" "${foo[@]}" )"
regex="${regex:${#separator}}" # remove leading separator
echo "${regex}"
# Prints: foo bar)|(foo baz)|(bar baz
0
287
$ foo=(a "b c" d)
$ bar=$(IFS=, ; echo "${foo[*]}")
$ echo "$bar"
a,b c,d
13
  • 22
    +1 for the most compact solution which does not need loops, which does not need external commands and which does not impose additional restrictions on the character set of the arguments.
    – ceving
    Sep 11, 2012 at 10:04
  • 35
    i like the solution, but it only works if IFS is one character
    – Jayen
    May 29, 2013 at 1:47
  • 14
    Any idea why this doesn't work if using @ instead of *, as in $(IFS=, ; echo "${foo[@]}") ? I can see that the * already preserves the whitespace in the elements, again not sure how, since @ is usually required for this sake.
    – haridsv
    Apr 15, 2014 at 7:33
  • 17
    I found the answer for my own question above. The answer is that IFS is only recognized for *. In bash man page, search for "Special Parameters" and look for the explanation next to *:
    – haridsv
    Apr 16, 2014 at 6:26
  • 6
    On the "${foo[@]}" vs "${foo[*]}" see also "Error code SC2145" of Shellcheck. Oct 28, 2017 at 13:12
78

Maybe, e.g.,

SAVE_IFS="$IFS"
IFS=","
FOOJOIN="${FOO[*]}"
IFS="$SAVE_IFS"

echo "$FOOJOIN"
14
  • 3
    If you do that, it thinks that IFS- is the variable. You have to do echo "-${IFS}-" (the curly braces separate the dashes from the variable name). Oct 6, 2009 at 18:57
  • 53
    That said, this still seems to work… So, like most things with Bash, I'll pretend like I understand it and get on with my life. Oct 6, 2009 at 20:06
  • 6
    A "-" is not a valid character for a variable name, so the shell does the right thing when you use $IFS-, you don't need ${IFS}- (bash, ksh, sh and zsh in linux and solaris also agree).
    – Idelic
    Oct 6, 2009 at 21:21
  • 2
    @David the difference between your echo and Dennis's is that he has used double quoting. The content of IFS is used 'on input' as a declaration of word-separator characters - so you'll always get an empty line without quotes. Oct 6, 2009 at 21:52
  • 3
    @DennisWilliamson: bash doesn't consider - as part of a variable name, whether you use brackets or not.
    – raphink
    Jan 20, 2012 at 11:22
51

Using no external commands:

$ FOO=( a b c )     # initialize the array
$ BAR=${FOO[@]}     # create a space delimited string from array
$ BAZ=${BAR// /,}   # use parameter expansion to substitute spaces with comma
$ echo $BAZ
a,b,c

Warning, it assumes elements don't have whitespaces.

5
  • 17
    If you don't want to use an intermediate variable, it can be done even shorter: echo ${FOO[@]} | tr ' ' ','
    – jesjimher
    May 24, 2016 at 9:31
  • 8
    I don't understand the negative votes. It's a much compact and readable solution than others posted here, and it's clearly warned that it doesn't work when there're spaces.
    – jesjimher
    May 24, 2016 at 9:32
  • This is what I needed. I had the need to have a space after comma, so in the BAZ step, with this solution, I could do that /, } Sep 30, 2022 at 15:16
  • I used a riff on this solution in a shell script to join a base network interface with a list of VLAN IDs to create subinterface names. Here's what I came up with: DHCP_VLAN="1 10 20 30"; DHCP_IF="eth1"; DHCP_IPFS=${DHCP_IF}.${DHCP_VLAN// / ${DHCP_IF}.}
    – SirNickity
    Jul 5, 2023 at 22:04
  • Not my downvote, but don't use upper case for your private variables.
    – tripleee
    Jan 27 at 14:02
40

This simple single-character delimiter solution requires non-POSIX mode. In POSIX mode, the elements are still joined properly, but the IFS=, assignment becomes permanent.

IFS=, eval 'joined="${foo[*]}"'

A script executed with the #!bash header respected executes in non-POSIX mode by default, but to help make sure a script runs in non-POSIX mode, add set +o posix or shopt -uo posix at the beginning of the script.


For multi-character delimiters, I recommend using a printf solution with escaping and indexing techniques.

function join {
    local __sep=${2-} __temp
    printf -v __temp "${__sep//%/%%}%s" "${@:3}"
    printf -v "$1" %s "${__temp:${#__sep}}"
}

join joined ', ' "${foo[@]}"

Or

function join {
    printf -v __ "${1//%/%%}%s" "${@:2}"
    __=${__:${#1}}
}

join ', ' "${foo[@]}"
joined=$__

This is based on Riccardo Galli's answer with my suggestion applied.

1
  • 1
    unfortunately works only for single-character delimiters
    – maoizm
    Apr 20, 2020 at 9:05
35

This isn't all too different from existing solutions, but it avoids using a separate function, doesn't modify IFS in the parent shell and is all in a single line:

arr=(a b c)
printf '%s\n' "$(IFS=,; printf '%s' "${arr[*]}")"

resulting in

a,b,c

Limitation: the separator can't be longer than one character.


This could be simplified to just

(IFS=,; printf '%s' "${arr[*]}")

at which point it's basically the same as Pascal's answer, but using printf instead of echo, and printing the result to stdout instead of assigning it to a variable.

7
  • I'm using this for join with a long delimiter, like this: printf '%s\n' "$((IFS="⁋"; printf '%s' "${arr[*]}") | sed "s,⁋,LONG DELIMITER,g"))". The is used as placeholder for replacement and can be any single character that can't occur in the array value (hence the uncommon unicode glyph).
    – Guss
    Oct 26, 2020 at 12:06
  • You can just use echo in the subshell, without having to invoke printf there
    – Treviño
    Apr 26, 2021 at 16:10
  • 1
    @Treviño I actually don't remember exactly why I used nested printfs, but I wouldn't switch the inner one to echo to avoid the ambiguities that come with using echo – but I could probably simplify to (IFS=,; printf -- '%s\n' "${arr[*]}") Apr 26, 2021 at 16:30
  • I'm actually going to leave it as is – if I made the change, it would basically become a copy of Pascal's answer, with the only difference being printf vs. echo. Apr 27, 2021 at 14:09
  • Or I'll just add the simplification and note the similarity. Apr 27, 2021 at 14:10
25

Here's a 100% pure Bash function that does the job:

join() {
    # $1 is return variable name
    # $2 is sep
    # $3... are the elements to join
    local retname=$1 sep=$2 ret=$3
    shift 3 || shift $(($#))
    printf -v "$retname" "%s" "$ret${@/#/$sep}"
}

Look:

$ a=( one two "three three" four five )
$ join joineda " and " "${a[@]}"
$ echo "$joineda"
one and two and three three and four and five
$ join joinedb randomsep "only one element"
$ echo "$joinedb"
only one element
$ join joinedc randomsep
$ echo "$joinedc"

$ a=( $' stuff with\nnewlines\n' $'and trailing newlines\n\n' )
$ join joineda $'a sep with\nnewlines\n' "${a[@]}"
$ echo "$joineda"
 stuff with
newlines
a sep with
newlines
and trailing newlines


$

This preserves even the trailing newlines, and doesn't need a subshell to get the result of the function. If you don't like the printf -v (why wouldn't you like it?) and passing a variable name, you can of course use a global variable for the returned string:

join() {
    # $1 is sep
    # $2... are the elements to join
    # return is in global variable join_ret
    local sep=$1 IFS=
    join_ret=$2
    shift 2 || shift $(($#))
    join_ret+="${*/#/$sep}"
}
6
  • 2
    Your last solution very good, but could be made cleaner by making join_ret a local variable, and then echoing it at the end. This allows join() to be used in the usual shell scripting way, e.g. $(join ":" one two three), and doesn't require a global variable. Mar 27, 2015 at 18:27
  • 1
    @JamesSneeringer I purposely used this design so as to avoid subshells. In shell scripting, unlike in many other languages, global variables used that way are not necessarily a bad thing; especially if they are here to help avoiding subshells. Moreover, $(...) trims trailing newlines; so if the last field of the array contains trailing newlines, these would be trimmed (see demo where they are not trimmed with my design). Mar 27, 2015 at 18:47
  • This works with multi-character separators, which makes me happy ^_^
    – spiffytech
    Nov 18, 2015 at 3:53
  • To address the "why wouldn't you like printf -v?": In Bash, local variables aren't truly function-local, so you can do things like this. (Call function f1 with local variable x, which in turn calls function f2 which modifies x - which is declared local within f1's scope) But it's not really how local variables ought to work. If local variables really are local (or are assumed to be, for instance in a script that must work on both bash and ksh) then it causes problems with this whole "return a value by storing it in the variable with this name" scheme.
    – tetsujin
    Sep 6, 2016 at 18:40
  • It's not 100% pure bash; you're calling /usr/bin/printf. Jul 17, 2020 at 21:11
20

I would echo the array as a string, then transform the spaces into line feeds, and then use paste to join everything in one line like so:

tr " " "\n" <<< "$FOO" | paste -sd , -

Results:

a,b,c

This seems to be the quickest and cleanest to me !

2
  • $FOO is just the first element of the array, though. Also, this breaks for array elements containing spaces. Jan 20, 2019 at 20:44
  • Instead print every element separated by a null character: printf '%s\0' "${FOO[@]}" | paste -zsd "," By that it supports array elements which contain spaces and new lines.
    – mgutt
    Jul 28, 2023 at 11:08
10

With re-use of @doesn't matters' solution, but with a one statement by avoiding the ${:1} substition and need of an intermediary variable.

echo $(printf "%s," "${LIST[@]}" | cut -d "," -f 1-${#LIST[@]} )

printf has 'The format string is reused as often as necessary to satisfy the arguments.' in its man pages, so that the concatenations of the strings is documented. Then the trick is to use the LIST length to chop the last sperator, since cut will retain only the lenght of LIST as fields count.

10

x=${arr[*]// /,}

This is the shortest way to do it.

Example,

# ZSH:
arr=(1 "2 3" 4 5)
x=${"${arr[*]}"// /,}
echo $x  # output: 1,2,3,4,5

# ZSH/BASH:
arr=(1 "2 3" 4 5)
a=${arr[*]}
x=${a// /,}
echo $x  # output: 1,2,3,4,5
3
  • 4
    This does not work correctly for string with spaces:`t=(a "b c" d); echo ${t[2]} (prints "b c"); echo ${"${t[*]}"// /,} (prints a,b,c,d)
    – kounoupis
    Feb 14, 2019 at 18:31
  • 1
    Non-array application (for a space-delimted string): RESULT=$(echo "${INPUT// /,") This also works with multi-char delimiters.
    – Akom
    Jun 7, 2021 at 15:49
  • 1
    Note that there is a syntax error in the bash version (at least when I tested on Mac). When I print x I get 1[*], which is not desired. To fix the second line needs to be wrapped with braces, like a=${arr[*]} Sep 15, 2021 at 16:24
8

Thanks @gniourf_gniourf for detailed comments on my combination of best worlds so far. Sorry for posting code not thoroughly designed and tested. Here is a better try.

# join with separator
join_ws() { local d=$1 s=$2; shift 2 && printf %s "$s${@/#/$d}"; }

This beauty by conception is

  • (still) 100% pure bash ( thanks for explicitly pointing out that printf is a builtin as well. I wasn't aware about this before ... )
  • works with multi-character delimiters
  • more compact and more complete and this time carefully thought over and long-term stress-tested with random substrings from shell scripts amongst others, covering use of shell special characters or control characters or no characters in both separator and / or parameters, and edge cases, and corner cases and other quibbles like no arguments at all. That doesn't guarantee there is no more bug, but it will be a little harder challenge to find one. BTW, even the currently top voted answers and related suffer from such things like that -e bug ...

Additional examples:

$ join_ws '' a b c
abc
$ join_ws ':' {1,7}{A..C}
1A:1B:1C:7A:7B:7C
$ join_ws -e -e
-e
$ join_ws $'\033[F' $'\n\n\n'  1.  2.  3.  $'\n\n\n\n'
3.
2.
1.
$ join_ws $ 
$
7

printf solution that accept separators of any length (based on @doesn't matters answer)

#/!bin/bash
foo=('foo bar' 'foo baz' 'bar baz')

sep=',' # can be of any length
bar=$(printf "${sep}%s" "${foo[@]}")
bar=${bar:${#sep}}

echo $bar
5
  • This produces output with a leading comma. Aug 21, 2013 at 15:13
  • The last bar=${bar:${#sep}} removes the separator. I just copy and pasted in a bash shell and it does work. What shell are you using? Aug 22, 2013 at 14:57
  • 3
    Any printf format specifier (eg. %s unintentionally in $sep will cause problems.
    – Peter.O
    May 22, 2015 at 17:55
  • 2
    sep can be sanitized with ${sep//\%/%%}. I like your solution better than ${bar#${sep}} or ${bar%${sep}} (alternative). This is nice if converted to a function that stores result to a generic variable like __, and not echo it.
    – konsolebox
    Sep 25, 2019 at 0:39
  • function join_by { printf -v __ "${1//\%/%%}%s" "${@:2}"; __=${__:${#1}}; }
    – konsolebox
    Sep 25, 2019 at 0:57
7
s=$(IFS=, eval 'echo "${FOO[*]}"')
7
  • 10
    You should flesh out your answer.
    – joce
    Mar 26, 2013 at 1:45
  • The very best one. Thanks!! Sep 9, 2016 at 8:26
  • 6
    I wish I could downvote this answer because it opens a security hole and because it will destroy spaces in elements.
    – eel ghEEz
    Dec 16, 2016 at 0:56
  • 1
    @bxm indeed, it seems to preserve spaces and it does not allow escaping from the echo arguments context. I figured that adding @Q could escape the joined values from misinterpreting when they have a joiner in them: foo=("a ," "b ' ' c" "' 'd e" "f " ";" "ls -latr"); s=$(IFS=, eval 'echo "${foo[*]@Q}"'); echo "${s}" outputs 'a ,','b '\'' '\'' c',''\'' '\''d e','f ',';','ls -latr '
    – eel ghEEz
    Jan 18, 2019 at 17:12
  • 1
    Avoid solutions that make use of subshells unless necessary.
    – konsolebox
    Sep 25, 2019 at 0:28
7

Shorter version of top answer:

joinStrings() { local a=("${@:3}"); printf "%s" "$2${a[@]/#/$1}"; }

Usage:

joinStrings "$myDelimiter" "${myArray[@]}"
2
  • 1
    A longer version, but no need to make a copy of a slice of the arguments to an array variable: join_strings () { local d="$1"; echo -n "$2"; shift 2 && printf '%s' "${@/#/$d}"; }
    – Rockallite
    Feb 12, 2017 at 7:22
  • Yet Another Version: join_strings () { local d="$1"; echo -n "$2"; shift 2 && printf '$d%s' "${@}"; } This works with usage: join_strings 'delim' "${array[@]}" or unquoted: join_strings 'delim' ${array[@]}
    – Cometsong
    Sep 6, 2018 at 15:25
4
$ set a 'b c' d

$ history -p "$@" | paste -sd,
a,b c,d
4
  • This should be at the top. Aug 13, 2015 at 18:54
  • 6
    This should not be at the top: what if HISTSIZE=0?
    – alephreish
    Nov 7, 2015 at 12:49
  • @har-wradim, the trick is about paste -sd, not about the use of history.
    – Veda
    Sep 7, 2017 at 11:52
  • @Veda No, it's about the use of the combination, and it wouldn't work if HISTSIZE=0 -- try it out.
    – alephreish
    Sep 7, 2017 at 14:19
4

Combine the best of all worlds so far with the following idea.

# join with separator
join_ws() {
    local IFS=
     local s="${*/#/$1}"
     echo "${s#"$1$1$1"}"
}

This little masterpiece is

  • 100% pure Bash (parameter expansion with IFS temporarily unset, no external calls, no printf ...)
  • compact, complete and flawless (works with single- and multi-character limiters, works with limiters containing white space, line breaks and other shell special characters, works with empty delimiter)
  • efficient (no subshell, no array copy)
  • simple and stupid and, to a certain degree, beautiful and instructive as well

Examples:

$ join_ws , a b c
a,b,c
$ join_ws '' a b c
abc
$ join_ws $'\n' a b c
a
b
c
$ join_ws ' \/ ' A B C
A \/ B \/ C
1
  • 6
    Not that nice: at least 2 problems: 1. join_ws , (with no arguments) wrongly outputs ,,. 2. join_ws , -e wrongly outputs nothing (that's because you're wrongly using echo instead of printf). I actually don't know why you advertised the use of echo instead of printf: echo is notoriously broken, and printf is a robust builtin. Mar 2, 2018 at 21:02
3

Here's a single liner that is a bit weird but works well for multi-character delimiters and supports any value (including containing spaces or anything):

ar=(abc "foo bar" 456)
delim=" | "
printf "%s\n$delim\n" "${ar[@]}" | head -n-1 | paste -sd ''

This would show in the console as

abc | foo bar | 456

Note: Notice how some solutions use printf with ${ar[*]} and some with ${ar[@]}?

The ones with @ use the printf feature that supports multiple arguments by repeating the format template.

The ones with * should not be used. They do not actually need printfand rely on manipulating the field separator and bash's word expansion. These would work just as well with echo, cat, etc. - these solutions likely use printf because the author doesn't really understand what they are doing...

3
  • I believe the solutions use printf because printf is better than echo. Also, head -n-1 is not portable (does not work on macOS, for example).
    – Old Pro
    Oct 26, 2022 at 6:44
  • @OldPro: I'm not complaining about the use of printf - I use it myself. I'm complaining about the use of ${ar[*]} that doesn't make any sense. I would also contend that echo, while not better, is often sufficient for simple output, especially if you don't want to bother with specifying the new line character every output.
    – Guss
    Oct 26, 2022 at 10:20
  • @OldPro: regarding head -n-1, yes - it isn't portable to Mac. It is also isn't portable to SunOS or AIX or any of the non-modern UN*X that don't support GNU. Unlike those though, on Mac you can brew install coreutils to get a compatible ghead, or do any of the other things mentioned here: superuser.com/q/543950/10942
    – Guss
    Oct 26, 2022 at 10:36
3

I believe this is the shortest solution, as Benamin W. already mentioned:

(IFS=,; printf %s "${a[*]}")

Wanted to add that if you use zsh, you can drop the subshell:

IFS=, printf %s "${a[*]}"

Test:

a=(1 'a b' 3)
IFS=, printf %s "${a[*]}"
1,a b,3
2

My attempt.

$ array=(one two "three four" five)
$ echo "${array[0]}$(printf " SEP %s" "${array[@]:1}")"
one SEP two SEP three four SEP five
1

Right now I'm using:

TO_IGNORE=(
    E201 # Whitespace after '('
    E301 # Expected N blank lines, found M
    E303 # Too many blank lines (pep8 gets confused by comments)
)
ARGS="--ignore `echo ${TO_IGNORE[@]} | tr ' ' ','`"

Which works, but (in the general case) will break horribly if array elements have a space in them.

(For those interested, this is a wrapper script around pep8.py)

3
  • from where do you get those array values? if you are hardcoding it like that, why not just foo="a,b,c".?
    – ghostdog74
    Oct 6, 2009 at 23:55
  • In this case I actually am hard-coding the values, but I want to put them in an array so I can comment on each individually. I've updated the answer to show you what I mean. Oct 7, 2009 at 5:11
  • Assuming you are actually using bash, this might work better: ARGS="--ignore $(echo "${TO_IGNORE[@]}" | tr ' ' ',')". Operator $() is more powerful than backtics (allows nesting of $() and ""). Wrapping ${TO_IGNORE[@]} with double quotes should also help.
    – kevinarpe
    Nov 8, 2013 at 16:58
1

Use perl for multicharacter separators:

function join {
   perl -e '$s = shift @ARGV; print join($s, @ARGV);' "$@"; 
}

join ', ' a b c # a, b, c

Or in one line:

perl -le 'print join(shift, @ARGV);' ', ' 1 2 3
1, 2, 3
1
  • works for me, although the join name conflicts with some crap on OS X.. i'd call it conjoined, or maybe jackie_joyner_kersee?
    – Alex Gray
    Jul 10, 2015 at 14:51
1

If you build the array in a loop, here is a simple way:

arr=()
for x in $(some_cmd); do
   arr+=($x,)
done
arr[-1]=${arr[-1]%,}
echo ${arr[*]}
1

In case the elements you want to join is not an array just a space separated string, you can do something like this:

foo="aa bb cc dd"
bar=`for i in $foo; do printf ",'%s'" $i; done`
bar=${bar:1}
echo $bar
    'aa','bb','cc','dd'

for example, my use case is that some strings are passed in my shell script and I need to use this to run on a SQL query:

./my_script "aa bb cc dd"

In my_script, I need to do "SELECT * FROM table WHERE name IN ('aa','bb','cc','dd'). Then above command will be useful.

2
  • You can use printf -v bar ... instead of having to run the printf loop in a subshell and capture the output. Oct 29, 2018 at 17:15
  • all the fancy upvoted solutions above didn't work but your crude one did for me (Y) Nov 26, 2019 at 8:31
1

Using variable indirection to refer directly to an array also works. Named references can also be used, but they only became available in 4.3.

The advantage of using this form of a function is that you can have the separator optional (defaults to the first character of default IFS, which is a space; perhaps make it an empty string if you like), and it avoids expanding values twice (first when passed as parameters, and second as "$@" inside the function).

This solution also doesn't require the user to call the function inside a command substitution - which summons a subshell, to get a joined version of a string assigned to another variable.

function join_by_ref {
    __=
    local __r=$1[@] __s=${2-' '}
    printf -v __ "${__s//\%/%%}%s" "${!__r}"
    __=${__:${#__s}}
}

array=(1 2 3 4)

join_by_ref array
echo "$__" # Prints '1 2 3 4'.

join_by_ref array '%s'
echo "$__" # Prints '1%s2%s3%s4'.

join_by_ref 'invalid*' '%s' # Bash 4.4 shows "invalid*[@]: bad substitution".
echo "$__" # Prints nothing but newline.

Feel free to use a more comfortable name for the function.

This works from 3.1 to 5.0-alpha. As observed, variable indirection doesn't only work with variables but with other parameters as well.

A parameter is an entity that stores values. It can be a name, a number, or one of the special characters listed below under Special Parameters. A variable is a parameter denoted by a name.

Arrays and array elements are also parameters (entities that store value), and references to arrays are technically references to parameters as well. And much like the special parameter @, array[@] also makes a valid reference.

Altered or selective forms of expansion (like substring expansion) that deviate reference from the parameter itself no longer work.

Update

In the release version of Bash 5.0, variable indirection is already called indirect expansion and its behavior is already explicitly documented in the manual:

If the first character of parameter is an exclamation point (!), and parameter is not a nameref, it introduces a level of indirection. Bash uses the value formed by expanding the rest of parameter as the new parameter; this is then expanded and that value is used in the rest of the expansion, rather than the expansion of the original parameter. This is known as indirect expansion.

Taking note that in the documentation of ${parameter}, parameter is referred to as "a shell parameter as described (in) PARAMETERS or an array reference". And in the documentation of arrays, it is mentioned that "Any element of an array may be referenced using ${name[subscript]}". This makes __r[@] an array reference.

Join by arguments version

See my comment in Riccardo Galli's answer.

4
  • 2
    Is there a specific reason to use __ as a variable name? Makes the code really unreadable.
    – PesaThe
    Jul 15, 2018 at 17:34
  • @PesaThe It's just a preference. I prefer using generic names for a return variable. Other non-generic names attribute themselves to specific functions, and it requires memorization. Calling multiple functions that return values on different variables can make the code less easy to follow. Using a generic name would force the scripter to transfer the value from the return variable to the proper variable to avoid conflict, and it makes the code end up being more readable since it becomes explicit where the returned values go. I make few exceptions to that rule though.
    – konsolebox
    Jul 15, 2018 at 23:34
  • I'm unable to get the code to work. I'm using 5.0.16(1)-release, and when I try to invoke the function, I get no output. Jul 17, 2020 at 21:07
  • @MarkPettit The function is not meant to produce an output. It stores the value to __. However, the first four commands do. Tested on 5.1.0(1)-alpha.
    – konsolebox
    Aug 4, 2020 at 12:35
1

Perhaps late for the party, but this works for me:

function joinArray() {
  local delimiter="${1}"
  local output="${2}"
  for param in ${@:3}; do
    output="${output}${delimiter}${param}"
  done

  echo "${output}"
}
1
  • The lack of quotes breaks inputs with quoted spaces; you want "${@:3}" with double quotes.
    – tripleee
    Jan 27 at 13:51
1

Many, if not most, of these solutions rely on arcane syntax, brain-busting regex tricks, or calls to external executables. I would like to propose a simple, bash-only solution that is very easy to understand, and only slightly sub-optimal, performance-wise.

join_by () {
    # Argument #1 is the separator. It can be multi-character.
    # Argument #2, 3, and so on, are the elements to be joined.
    # Usage: join_by ", " "${array[@]}"
    local SEPARATOR="$1"
    shift

    local F=0
    for x in "$@"
    do
        if [[ F -eq 1 ]]
        then
            echo -n "$SEPARATOR"
        else
            F=1
        fi
        echo -n "$x"
    done
    echo
}

Example:

$ a=( 1 "2 2" 3 )
$ join_by ", " "${a[@]}"
1, 2 2, 3
$ 

I'd like to point out that any solution that uses /usr/bin/[ or /usr/bin/printf is inherently slower than my solution, since I use 100% pure bash. As an example of its performance, Here's a demo where I create an array with 1,000,000 random integers, then join them all with a comma, and time it.

$ eval $(echo -n "a=("; x=0 ; while [[ x -lt 1000000 ]]; do echo -n " $RANDOM" ; x=$((x+1)); done; echo " )")
$ time join_by , ${a[@]} >/dev/null
real    0m8.590s
user    0m8.591s
sys     0m0.000s
$ 
5
  • As an additional benefit, this won't only work on arrays. It'll work on files, too: Jul 17, 2020 at 21:17
  • Your "inherently faster" solution is 2.9 times slower than the printf approach. Jan 15, 2021 at 4:35
  • 1
    @MarkPettit printf is a bash built-in. See gnu.org/software/bash/manual/html_node/… Feb 24, 2021 at 18:39
  • And [ too has a built-in version that's used unless someone goes out of their way to force the external executable. There are reasons to prefer [[, but avoiding the performance cost of starting an external executable is not one of them. Feb 22, 2023 at 17:15
  • echo -n is safe as long as you are In Bash; but I still cringe because printf is both prettier and more portable,
    – tripleee
    Jan 27 at 13:50
1

This one particularly works with busybox's sh and $@:

$ FOO=(a b c)
$ printf '%s\n' "${FOO[@]}" | paste -sd,
a,b,c

Or:

join_by() {
    local d=$1
    shift
    printf '%s\n' "$@" | paste -sd "$d"
}
join_by , "${FOO[@]}"  # a,b,c
0

This approach takes care of spaces within the values, but requires a loop:

#!/bin/bash

FOO=( a b c )
BAR=""

for index in ${!FOO[*]}
do
    BAR="$BAR,${FOO[$index]}"
done
echo ${BAR:1}
0

Perhaps I'm missing something obvious, since I'm a newb to the whole bash/zsh thing, but it looks to me like you don't need to use printf at all. Nor does it get really ugly to do without.

join() {
  separator=$1
  arr=$*
  arr=${arr:2} # throw away separator and following space
  arr=${arr// /$separator}
}

At least, it has worked for me thus far without issue.

For instance, join \| *.sh, which, let's say I'm in my ~ directory, outputs utilities.sh|play.sh|foobar.sh. Good enough for me.

EDIT: This is basically Nil Geisweiller's answer, but generalized into a function.

1
  • 2
    I'm not the downvoter, but manipulating a global in a function seems pretty wacky.
    – tripleee
    Feb 21, 2018 at 5:17

Not the answer you're looking for? Browse other questions tagged or ask your own question.