My application does large data arrays processing and needs more memory than JVM gives by default. I know in Java it's specified by "-Xmx" option. How do I set SBT up to use particular "-Xmx" value to run an application with "run" action?
11 Answers
For forked processes you should look at Build.scala
To modify the java options for forked processes you need to specify them in the Build.scala (or whatever you've named your build) like this:
val buildSettings = Defaults.defaultSettings ++ Seq(
//…
javaOptions += "-Xmx1G",
//…
)
This will give you the proper options without modifying JAVA_OPTS globally, and it will put custom JAVA_OPTS in an sbt generated start-script
For non forked processes it's most convenient to set the config via sbtopts
or sbtconfig
depending on your sbt version.
Since sbt 0.13.6 .sbtconfig
is deprecated. Modify /usr/local/etc/sbtopts
along these lines:
-J-Xms512M
-J-Xmx3536M
-J-Xss1M
-J-XX:+CMSClassUnloadingEnabled
-J-XX:+UseConcMarkSweepGC
-J-XX:MaxPermSize=724M
-J-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005
You can also create an .sbtopts
file in the root of your SBT project using the same syntax as in the /usr/local/etc/sbtopts
file. This makes the project self-contained.
Before sbt 0.13.6 you could set the options in .sbtconfig for non forked processes:
Check where sbt is:
$ which sbt /usr/local/bin/sbt
Look at the contents:
$ cat /usr/local/bin/sbt #!/bin/sh test -f ~/.sbtconfig && . ~/.sbtconfig exec java ${SBT_OPTS} -jar /usr/local/Cellar/sbt/0.12.1/libexec/sbt-launch.jar "$@"
Set the correct jvm options to prevent OOM (both regular and PermGen):
$ cat ~/.sbtconfig SBT_OPTS="-Xms512M -Xmx3536M -Xss1M -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC -XX:MaxPermSize=724M"
If you want to set SBT_OPTS only for the current run of sbt you can use env SBT_OPTS=".." sbt
as suggested by Googol Shan. Or you can use the option added in Sbt 12: sbt -mem 2048
. This gets unwieldy for longer lists of options, but it might help if you have different projects with different needs.
Note that CMSClassUnloadingEnabled in concert with UseConcMarkSweepGC helps keep the PermGen space clean, but depending on what frameworks you use you might have an actual leak on PermGen, which eventually forces a restart.
-
@iwein - The javaOptions did not change the default heapspace for sbt. I checked in jconsole and it just shows -Xmx512M. Even if I add the SBT_OPTS in ~/.sbtconfig, I still get this in jconsole: -Xmx512M -Xms256M -Xmx1G -XX:MaxPermSize=256M -XX:+UseConcMarkSweepGC. Do you see the Xmx512 up in the front? It some how doesn't pick the javaOptions from Build.scala. Any pointers?– AnandDec 9, 2014 at 6:02
-
@Anand perhaps things are working slightly differently in 0.13? I'll update the answer if I bump into anything (might take a while), let me know if you figure it out in the mean time.– iweinDec 12, 2014 at 21:25
-
@iwein I just used the following in my Build.scala and it worked. fork in run := true, javaOptions in run ++= Seq("-Xms256m", "-Xmx2048m", "-XX:+UseConcMarkSweepGC"). See this post for the answer stackoverflow.com/questions/27372468/…. Thanks!– AnandDec 15, 2014 at 5:22
-
3FYI you can also create a
.sbtopts
file in the root of your SBT project using the same syntax as in the/usr/local/etc/sbtopts
file. This makes your project self-contained, which can be very handy in CI situations. Jan 4, 2016 at 9:01 -
1On Windows using 0.13.9 (might be 0.13.6) the file is C:\Program Files (x86)\sbt\conf\sbtconfig.txt. By default the file had "-Xmx512M" in it without the -J shown in this answer. I can confirm that this file is being read by the fact that sbt assembly issues a warning regarding -XX:MaxPermSize and when I change that value the warning shows the value I entered and not the "256m" value it showed originally. Feb 3, 2017 at 0:44
In sbt version 12 onwards there is an option for this:
$sbt -mem 2048
-
5on win 8.1, this command did not work for me:
Not a valid command: mem (similar: set)
Apr 17, 2015 at 20:53
If you run sbt on linux shell, you can use:
env JAVA_OPTS="-Xmx512m" sbt run
This is my usually used command to run my sbt project.
-
1Thank you very much. A cool command to know. I never knew of that "env" and missed such a tool many times.– IvanNov 5, 2010 at 4:44
-
4Hmm, this didn't work for me! I needed the
override def fork
solution above. (sbt 0.7.7) Jul 5, 2011 at 16:02 -
2it is possible that your sbt file specifies its own JAVA_OPTS, in which case these will be overwritten. You can then just directly modify your sbt file, either to remove the -Xmx flag or to switch it to your desired maximum heap size.– nnythmMar 1, 2012 at 18:21
-
.sbtconfig
is deprecated starting with SBT 0.13.6
. Instead, I configured these options in /usr/local/etc/sbtopts
in the following way:
-J-Xms512M
-J-Xmx3536M
-J-Xss1M
-J-XX:+CMSClassUnloadingEnabled
-J-XX:+UseConcMarkSweepGC
-J-XX:MaxPermSize=724M
-J-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005
-
1
-J-Xss1M
is a bit low for large case classes, 4M seems to be safer. Dec 24, 2015 at 11:06
Try this:
class ForkRun(info: ProjectInfo) extends DefaultProject(info) {
override def fork = Some(new ForkScalaRun {
override def runJVMOptions = super.runJVMOptions ++ Seq("-Xmx512m")
override def scalaJars = Seq(buildLibraryJar.asFile, buildCompilerJar.asFile)
})
}
-
54
-
1
-
2Note that
javaOptions
only have effect for forked JVMs (see scala-sbt.org/0.13/docs/Forking.html)– YarNov 26, 2015 at 15:50 -
1
-
@coanor this answer is for an ancient version of sbt. There is an answer with much higher rankings just under this one. This answer was the correct answer at the time when the question was asked.– ArneApr 10, 2016 at 14:28
There's one way I know of. Set the environment variable JAVA_OPTS.
JAVA_OPTS='-Xmx512m'
I have not found a way to do this as a command parameter.
Use JAVA_OPTS for setting with environment variable.
Use -J-X options to sbt for individual options, e.g. -J-Xmx2048 -J-XX:MaxPermSize=512
Newer versions of sbt have a "-mem" option.
The javaOptions += "-XX:MaxPermSize=1024"
in our build.sbt as referenced by @iwein above worked for us when we were seeing a java.lang.OutOfMemoryError thrown while running Specs2 tests through sbt.
-
1
The environment variable is _JAVA_OPTIONS, which needs to be set. Once you set _JAVA_OPTIONS, and when you sbt, sbt will show the message using JAVA_OPTIONS and the values.
Alternatively you could set javaOption in the sbt or .scala file e.g
javaOptions += "-Xmx1G"
From sbt shell you could run show javaOptions to see the values that are set.
sbt lets you list the JVM options you need to run your project on a file named
.jvmopts
in the root of your project. then add the java options that you want
cat .jvmopts
-Xms512M
-Xmx4096M
-Xss2M
-XX:MaxMetaspaceSize=1024M
it is tested and works in windows 10 https://www.lagomframework.com/documentation/1.4.x/scala/JVMMemoryOnDev.html
javaOptions in Test += "-Xmx1G"
This sets the JVM options for tests. Works also with jvm forking (fork in Test := true
).
-
1
-
Anywhere, if you have a 1-module project. The order of definitions does not generally matter in SBT. If you have multiple modules, specify this either on some of them or, if you want, globally via
javaOptions in ThisBuild += "-Xmx1G"
orjavaOptions in (ThisBuild, Test) += "-Xmx1G"
Jan 11, 2017 at 7:33