21

I want to build a bash program that can read a file, like a *.bin and print all its hexadecimal numbers, as 'hex' editors do. Where I can start?

0

5 Answers 5

28

Use the od command:

od -t x1  filename

Sample output:

$ printf '0123456789abcdef0123456789abcdef\x00\x01\x02\x03\x04\x05\x06\x07\x08\x09\x0a\x0b\x0c\x0d\x0e\x0f' | od -t x1
0000000 30 31 32 33 34 35 36 37 38 39 61 62 63 64 65 66
*
0000040 00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f
0000060
5
  • Is od a Linux program or a bash function? Sorry, I'm a really beginner. Jan 5, 2010 at 2:39
  • 2
    @Nathan Campos: you can find out using which od, if you get the name of a program then it's an external program (for od, it probably is). Jan 5, 2010 at 2:46
  • 4
    pretty standard in unixes, been around since the dawn of time. Jan 5, 2010 at 3:00
  • @GregHewgill Thats wrong. Look at this from my Ubuntu machine. ~ $ type [ [ is a shell builtin ~ $ which [ /usr/bin/[
    – GKFX
    Jan 9, 2015 at 17:48
  • 1
    @NathanCampos more importantly, it is POSIX: pubs.opengroup.org/onlinepubs/9699919799/utilities/od.html :-) Sep 4, 2015 at 8:20
26

Edit: Added "bytestream" functionality. If the script name contains the word "stream" (e.g. it's a symlink such as ln -s bash-hexdump bash-hexdump-stream and run as ./bash-hexdump-stream), it will output a continuous stream of hex characters representing the contents of the file. Otherwise its output will look like hexdump -C.

It takes a bunch of trickery since Bash isn't really good at binary:

#!/bin/bash
# bash-hexdump
# by Dennis Williamson - 2010-01-04
# in response to http://stackoverflow.com/questions/2003803/show-hexadecimal-numbers-of-a-file
# usage: bash-hexdump file

if [[ -z "$1" ]]
then
    exec 3<&0                           # read stdin
    [[ -p /dev/stdin ]] || tty="yes"    # no pipe
else
    exec 3<"$1"            # read file
fi

# if the script name contains "stream" then output will be continuous hex digits
# like hexdump -ve '1/1 "%.2x"'
[[ $0 =~ stream ]] && nostream=false || nostream=true

saveIFS="$IFS"
IFS=""                     # disables interpretation of \t, \n and space
saveLANG="$LANG"
LANG=C                     # allows characters > 0x7F
bytecount=0
valcount=0
$nostream && printf "%08x  " $bytecount
while read -s -u 3 -d '' -r -n 1 char    # -d '' allows newlines, -r allows \
do
    ((bytecount++))
    printf -v val "%02x" "'$char"    # see below for the ' trick
    [[ "$tty" == "yes" && "$val" == "04" ]] && break    # exit on ^D
    echo -n "$val"
    $nostream && echo -n " "
    ((valcount++))
    if [[ "$val" < 20 || "$val" > 7e ]]
    then
        string+="."                  # show unprintable characters as a dot
    else
        string+=$char
    fi
    if $nostream && (( bytecount % 8 == 0 ))      # add a space down the middle
    then
        echo -n " "
    fi
    if (( bytecount % 16 == 0 ))   # print 16 values per line
    then
        $nostream && echo "|$string|"
        string=''
        valcount=0
        $nostream && printf "%08x  " $bytecount
    fi
done

if [[ "$string" != "" ]]            # if the last line wasn't full, pad it out
then
    length=${#string}
    if (( length > 7 ))
    then
        ((length--))
    fi
    (( length += (16 - valcount) * 3 + 4))
    $nostream && printf "%${length}s\n" "|$string|"
    $nostream && printf "%08x  " $bytecount
fi
$nostream && echo

LANG="$saveLANG";
IFS="$saveIFS"

The apostrophe trick is documented here. The relevant part says:

If the leading character is a single-quote or double-quote, the value shall be the numeric value in the underlying codeset of the character following the single-quote or double-quote.

Here is some output from the script showing the first few lines of my /bin/bash plus a few more:

00000000  7f 45 4c 46 01 01 01 00  00 00 00 00 00 00 00 00  |.ELF............|
00000010  02 00 03 00 01 00 00 00  e0 1e 06 08 34 00 00 00  |............4...|
00000020  c4 57 0d 00 00 00 00 00  34 00 20 00 09 00 28 00  |.W......4. ...(.|
00000030  1d 00 1c 00 06 00 00 00  34 00 00 00 34 80 04 08  |........4...4...|
. . .
00000150  01 00 00 00 2f 6c 69 62  2f 6c 64 2d 6c 69 6e 75  |..../lib/ld-linu|
00000160  78 2e 73 6f 2e 32 00 00  04 00 00 00 10 00 00 00  |x.so.2..........|
00000170  01 00 00 00 47 4e 55 00  00 00 00 00 02 00 00 00  |....GNU.........|
3
  • 1
    By the way, the output format of this script is the same as hexdump -C or hd. Jan 5, 2010 at 5:08
  • 2
    Nice to see someone doing unusual and even binary things with bash. Very interesting piece of code !
    – ajaaskel
    Nov 15, 2014 at 21:29
  • @nkvnkv: Read the question: "I want to build a bash program..." Also, notice that my answer was accepted by the OP and read the comments attached to my answer. Thanks for the downvote. Apr 22, 2016 at 23:28
3

You could use od. "od -x file" Why reinvent that wheel?

1

you can also use hexdump if you have it

hexdump -x /usr/bin/binaryfile
0

Get raw hex byte string without any formatting

This form can also be useful when you want to convert data rather than view it manually:

od -An -v -tx1 | tr -d ' \n'

Example:

printf '0123456789abcdef0123456789abcdef\x00\x01\x02\x03\x04\x05\x06\x07\x08\x09\x0a\x0b\x0c\x0d\x0e\x0f' | od -An -v -tx1 | tr -d ' \n'

Output:

3031323334353637383961626364656630313233343536373839616263646566000102030405060708090a0b0c0d0e0f

So no spaces or newlines, just the hex.

Tested on Ubuntu 23.04.

Related: How to create a hex dump of file containing only the hex characters without spaces in bash?

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.