74

I'm having problems posting JSON with UTF-8 encoding using RestTemplate. Default encoding for JSON is UTF-8 so the media type shouldn't even contain the charset. I have tried to put charset in the MediaType but it doesn't seem to work anyway.

My code:

String dataJson = "{\"food\": \"smörrebröd\"}";
HttpHeaders headers = new HttpHeaders();
MediaType mediaType = new MediaType("application", "json", StandardCharsets.UTF_8);
headers.setContentType(mediaType);

HttpEntity<String> entity = new HttpEntity<String>(dataJson, headers);
RestTemplate restTemplate = new RestTemplate();
ResponseEntity<Boolean> formEntity = restTemplate.exchange(postUrl, HttpMethod.POST, entity, Boolean.class);

10 Answers 10

171

You need to add StringHttpMessageConverter to rest template's message converter with charset UTF-8. Like this

RestTemplate restTemplate = new RestTemplate();
restTemplate.getMessageConverters()
        .add(0, new StringHttpMessageConverter(StandardCharsets.UTF_8));
10
  • 4
    Worked like a charm. I had an issue with a special character which look's like '(single quotes). Had a nightmare in parsing it. Simple tweak worth a 1000 votes Commented Oct 31, 2016 at 13:39
  • @mushfek0001 it didn't help i changed as mentioned below. I was able to change charset
    – Sandesh
    Commented Jan 26, 2017 at 20:08
  • How can I switch between charset 8 and 16 Commented May 31, 2018 at 15:09
  • 4
    Why .add(0, ... and not just .add(new StringHttp...? Commented Jan 23, 2019 at 22:53
  • 1
    why this isn't default? It took me half an hour to check char by char to notice bad encoding :( Commented Apr 22, 2021 at 4:53
33

(Adding to solutions by mushfek0001 and zhouji)

By default RestTemplate has ISO-8859-1 StringHttpMessageConverter which is used to convert a JAVA object to request payload.

Difference between UTF-8 and ISO-8859:

UTF-8 is a multibyte encoding that can represent any Unicode character. ISO 8859-1 is a single-byte encoding that can represent the first 256 Unicode characters. Both encode ASCII exactly the same way.

Solution 1 (copied from mushfek001):

RestTemplate restTemplate = new RestTemplate();
restTemplate.getMessageConverters()
        .add(0, new StringHttpMessageConverter(Charset.forName("UTF-8")));

Solution 2:

Though above solution works, but as zhouji pointed out, it will add two string converters and it may lead to some regression issues.

If you set the right content type in http header, then ISO 8859 will take care of changing the UTF characters.

HttpHeaders headers = new HttpHeaders();
headers.setContentType(MediaType.APPLICATION_JSON_UTF8);

or

// HttpUriRequest request
request.addHeader("Content-Type", MediaType.APPLICATION_JSON_UTF8_VALUE);
7
  • Solution 2 is not an option for non-standard content types, like the one used for bulk operation in ElasticSearch REST API (application/x-ndjson). Commented Oct 5, 2018 at 13:07
  • solution 1 works, but solution 2 headers.setContentType(MediaType.APPLICATION_JSON_UTF8); not work, sprint boot version 2.1.2, jdk 1.8
    – Joey
    Commented Jan 17, 2019 at 8:12
  • Solution 2 is working simply with headers.setContentType(MediaType.APPLICATION_JSON_UTF8); It is simple and elegant solution. Nice explanation too.
    – UM1979
    Commented Jul 11, 2019 at 9:54
  • 4
    MediaType.APPLICATION_JSON_UTF8_VALUE is deprecated now Commented Mar 11, 2020 at 13:08
  • can we do the same with @Autowired RestTemplate?
    – USM
    Commented Apr 6, 2020 at 13:21
10

The answer by @mushfek0001 produce two StringHttpMessageConverter which will send two text/plain and */*, such as the debug picture.

enter image description here

Even the Accept header of client will be:

text/plain, text/plain, */*, */*

So the better one is remove the ISO-8859-1 StringHttpMessageConverter and use single UTF-8 StringHttpMessageConverter.

Use this:

RestTemplate restTemplate = new RestTemplate();
StringHttpMessageConverter stringHttpMessageConverter = new StringHttpMessageConverter(StandardCharsets.UTF_8);
stringHttpMessageConverter.setWriteAcceptCharset(true);
for (int i = 0; i < restTemplate.getMessageConverters().size(); i++) {
    if (restTemplate.getMessageConverters().get(i) instanceof StringHttpMessageConverter) {
        restTemplate.getMessageConverters().remove(i);
        restTemplate.getMessageConverters().add(i, stringHttpMessageConverter);
        break;
    }
}
2
  • I haven't observe such problem. In my case the Accept header had value application/json, application/*+json which is OK. Commented Oct 5, 2018 at 13:20
  • 1
    can we do the same with @Autowired RestTemplate?
    – USM
    Commented Apr 6, 2020 at 13:21
3

Adding new StringHttpMessageConverter won't help. In existing StringHttpMessageConverter we need to set writeAcceptCharset to false and build httpheader with charset we want.

RestTemplate restTemplate = new RestTemplate();
   List<HttpMessageConverter<?>> c = restTemplate.getMessageConverters();
        for(HttpMessageConverter<?> mc :c){
            if (mc instanceof StringHttpMessageConverter) {
                StringHttpMessageConverter mcc = (StringHttpMessageConverter) mc;
                mcc.setWriteAcceptCharset(false);
            }
   }

  HttpHeaders headers = new HttpHeaders();
  headers.setAccept(Arrays.asList(MediaType.APPLICATION_JSON));
  headers.setAcceptCharset(Arrays.asList(Charset.forName("UTF-8")));
  HttpEntity<String> entity = new HttpEntity<String>(jsonPayload, headers);

  restTemplate.postForEntity(postResourceUrl, entity, String.class);
1
  • 1
    Adding new StringHttpMessageConverter helped.
    – Alex78191
    Commented Apr 28, 2018 at 12:25
2

Removing the existing converter, but with Java 8 (why do people still write Java 7 Code anyways?)

List<HttpMessageConverter<?>> converters = restTemplate.getMessageConverters();
converters.removeIf(httpMessageConverter -> httpMessageConverter instanceof StringHttpMessageConverter);
converters.add(0, new StringHttpMessageConverter(StandardCharsets.UTF_8));
1
restTemplate.getMessageConverters().add(0, new StringHttpMessageConverter(StandardCharsets.UTF_16LE));

String response = restTemplate.getForObject(url, String.class);
1
  • Can you provide some context to your answer, that way future readers can learn how to apply it to their issues and not just in this situation.
    – Newd
    Commented Jul 28, 2015 at 14:28
1

Better you should remove the StringHttpMessageConverter first before adding new. so this way you will have one instance of StringHttpMessageConverter in our MessageConverters list.

RestTemplate restTemplate = new RestTemplate();
        final Iterator<HttpMessageConverter<?>> iterator = restTemplate.getMessageConverters().iterator();
        while (iterator.hasNext()) {
            final HttpMessageConverter<?> converter = iterator.next();
            if (converter instanceof StringHttpMessageConverter) {
                iterator.remove();
            }
        }


        restTemplate.getMessageConverters().add(0, new StringHttpMessageConverter(Charset.forName("UTF-8")));
0

Try this

restTemplate.getMessageConverters().set(1,new StringHttpMessageConverter(Charsets.UTF_8));
0

If you're using Spring Boot it will auto-configure RestTemplate with a high-priority UTF-8 charset StringHttpMessageConverter, if you use RestTemplateBuilder to create the RestTemplate instance. E.g. restTemplateBuilder.build()

0

You can also do

HttpHeaders attachmentHeader = new HttpHeaders();
attachmentHeader.setContentType(MediaType.valueOf("text/csv; charset=UTF-8"));

Or

 attachmentHeader.set("Content-Type", "text/csv; charset=UTF-8");

Not the answer you're looking for? Browse other questions tagged or ask your own question.