34

Is there a reader function in clojure to parse clojure data structure? My use case is to read configuration properties files and one value for a property should be a list. I'd like to be able to write this as:

file.properties:

property1 = ["value1" "value2"]

and in clojure:

(load-props "file.properties")

and get a map with value {property1, ["value1" "value2"]

Right now,m I'm doing the following, with the same input file "file.properties":

(defn load-props [filename]
    (let [io (java.io.FileInputStream. filename)
        prop (java.util.Properties.)]
    (.load prop io)
    (into {} prop)))

;; returns:
;; {"property1" "[\"valu1\", \"valu2\"]"}
(load-props "file.properties")

But I cannot get a way to parse the result to a clojure's vector. I'm basically looking for something like Erlang's file:consult/1 function. Any idea how to do this?

2
  • Jonas' answer is also a good option if you're not set on a properties file.
    – Dave Ray
    Oct 16, 2011 at 12:00
  • Korny's answer is the best one here in 2013.
    – noahlz
    May 11, 2013 at 10:55

5 Answers 5

45

If you want to read java-style properties files, look at Dave Ray's answer - though properties files have many limitations.

If you are using Clojure 1.5 or later, I suggest you use edn, the extensible data notation used in Datomic - it's basically clojure data structures, with no arbitrary code execution, and the ability to add tags for things like instances or arbitrary types.

The simplest way to use it is via read-string and slurp:

(require 'clojure.edn)
(clojure.edn/read-string (slurp "filename.edn"))

That's it. Note that read-string only reads a single variable, so you should set up your configuration as a map:

{ :property1 ["value1" "value2"] }

Then:

(require 'clojure.edn)
(def config (clojure.edn/read-string (slurp "config.edn")))
(println (:property1 config))

returns

["value1" "value2"]
32

java.util.Properties implements Map so this can be done very easily without manually parsing properties files:

(require 'clojure.java.io)
(defn load-props
  [file-name]
  (with-open [^java.io.Reader reader (clojure.java.io/reader file-name)] 
    (let [props (java.util.Properties.)]
      (.load props reader)
      (into {} (for [[k v] props] [(keyword k) (read-string v)])))))

(load-props "test.properties")
;=> {:property3 {:foo 100, :bar :test}, :property2 99.9, :property1 ["foo" "bar"]}

In particular, properties files are more complicated than you think (comments, escaping, etc, etc) and java.util.Properties is very good at loading them.

2
25

Is there a reader function in clojure to parse clojure data structure?

Yes. It's called read. You can also use it to read configuration data.

A file props.clj containing

{:property1 ["value1" 2]
 :property2 {:some "key"}}

can be read like this:

(ns somens.core
  (:require [clojure.java.io :as io])
  (:import [java.io PushbackReader]))

(def conf (with-open [r (io/reader "props.clj")]
            (read (PushbackReader. r))))

When reading untrusted sources it might be a good idea to turn of *read-eval*:

(def conf (binding [*read-eval* false]
            (with-open [r (io/reader "props.clj")]
              (read (PushbackReader. r)))))

For writing configuration data back to a file you should look at print functions such as pr and friends.

3
  • Note that the file is never closed in your code. Use with-open.
    – Dave Ray
    Oct 16, 2011 at 12:02
  • 7
    Note that since clojure 1.5 you should use clojure.edn/read as read can execute arbitrary code, and edn is designed to be safe and portable.
    – Korny
    Apr 21, 2013 at 0:41
  • Oh, and you can just use (read (slurp "props.clj")) - using a reader makes sense if you are reading large amounts of data, but is overkill for a simple config file.
    – Korny
    Apr 21, 2013 at 1:03
3

contrib has functions for reading writing properties,

http://richhickey.github.com/clojure-contrib/java-utils-api.html#clojure.contrib.java-utils/as-properties

If this is for your own consumption then I would suggest reading/writing clojure data structures you can just print them to disk and read them.

2
  • I don't have java-utils contrib package installed in my machine. Will test this later.
    – Ahmed
    Oct 15, 2011 at 18:51
  • 2
    Clojure's API documentation has moved to clojure.github.com/clojure, and clojure-contrib has been deprecated/moved out into separate libraries under that same github account.
    – Rayne
    Oct 16, 2011 at 5:32
0
(use '[clojure.contrib.duck-streams :only (read-lines)])
(import '(java.io StringReader PushbackReader))

(defn propline->map [line] ;;property1 = ["value1" "value2"] -> { :property1  ["value1" "value2"] }
  (let [[key-str value-str] (seq (.split line "="))
        key (keyword (.trim key-str))
        value (read (PushbackReader. (StringReader. value-str)))]
        { key value } ))

(defn load-props [filename]
  (reduce into (map propline->map (read-lines filename))))

DEMO

user=> (def prop (load-props "file.properties"))
#'user/prop
user=> (prop :property1)
["value1" "value2"]
user=> ((prop :property1) 1)
"value2"

UPDATE

(defn non-blank?   [line] (if (re-find #"\S" line) true false))
(defn non-comment? [line] (if (re-find #"^\s*\#" line) false true))

(defn load-props [filename]
  (reduce into (map propline->map (filter #(and (non-blank? %)(non-comment? %)) (read-lines filename)))))
7
  • Great, this is exactly what I needed. I've done changes so that propline->map function avoids comments. The updated version is below (defn propline->map [line] (let [[key-str value-str] (seq (.split line "=")) key (keyword (.trim key-str)) value (read (PushbackReader. (StringReader. value-str))) comment? (.startsWith key-str "#")] (if (not comment?) { key value }) ))`
    – Ahmed
    Oct 15, 2011 at 18:46
  • If you exclude the comment line that filter might be better in load-props.
    – BLUEPIXY
    Oct 15, 2011 at 21:25
  • 2
    Two things: 1) Properties already knows how to parse these files correctly. No need to partially reimplement that functionality. 2) duck-streams is deprecated. You want clojure.java.io/reader and clojure.core/line-seq.
    – Dave Ray
    Oct 15, 2011 at 23:49
  • 1)Yes. ex)(def v (read (PushbackReader. (StringReader. "[\"valu1\", \"valu2\"]")))). 2)Well I do not. I dont know deprecated.But,Can be replaced if necessary.
    – BLUEPIXY
    Oct 16, 2011 at 8:35
  • blog.darevay.com/2010/10/…
    – BLUEPIXY
    Oct 16, 2011 at 9:04

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.