We have a JAVA web app which uses postgres(single database with a slave) for storing all the important data.
We are now moving from a single server setup to mutiple servers due to which i need to make some changes to address the new requirements.
1) Non sticky session ids for load balancing and partition tolerance.
2) Cache of frequently read data accessible from all web servers (In Memory/Memcache alternative).
3) Queues(Email, SMS, Tasks to executed over the cluster). Typically all of them have to be executed over an xml api or screen scraping.
Avoiding duplicate processing of tasks is important but sometimes it can happen :-)
4) Persistent storage of API requests and responses(lots of XML, lots of rows but small number of columns). (probably archive by removing old requests and responses to keep the data set small).
5) Logging to a common place. The table will keep on growing. Also i would need a tool to access logs of production without stopping them. Some sort of search should be possible based on time and or search string.
I want a single solution to address all these requirements and looking at redis, mongo and hazelcast(in order of my personal preference) as possible alternatives.
Other important considerations: 1) Less intrusion into our code. 2) Easy backup/replication strategies. At least Master Slave. 3) Manageability, Community and tried and tested(running in production).
Which will be able to perform all or most out of this features and requirements?
EDIT - What i did
- Redis backed session manager for tomact.
- Redis for caching
- Jesque (Respue's java version) backed by redis.
- Postgres
- SLF4J backed by Log4j2