Questions tagged [scalability]

Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

scalability
Filter by
Sorted by
Tagged with
1222 votes
29 answers
210k views

Has Django served an excess of 100k daily visits? [closed]

I'm building a web application with Django. The reasons I chose Django were: I wanted to work with free/open-source tools. I like Python and feel it's a long-term language, whereas regarding Ruby I ...
Roee Adler's user avatar
  • 33.8k
814 votes
10 answers
470k views

Difference between scaling horizontally and vertically for databases [closed]

I have come across many NoSQL databases and SQL databases. There are varying parameters to measure the strength and weaknesses of these databases and scalability is one of them. What is the difference ...
London guy's user avatar
  • 27.7k
189 votes
9 answers
56k views

How Scalable is SQLite? [closed]

I recently read this Question about SQLite vs MySQL and the answer pointed out that SQLite doesn't scale well and the official website sort-of confirms this, however. How scalable is SQLite and what ...
GateKiller's user avatar
172 votes
9 answers
160k views

What is considered a good response time for a dynamic, personalized web application? [closed]

For a complex web application that includes dynamic content and personalization, what is a good response time from the server (so excluding network latency and browser rendering time)? I'm thinking ...
Michael Bobick's user avatar
151 votes
18 answers
72k views

How to write a scalable TCP/IP based server

I am in the design phase of writing a new Windows service application that accepts TCP/IP connections for long running connections (i.e., this is not like HTTP where there are many short connections, ...
Erik Funkenbusch's user avatar
134 votes
9 answers
57k views

WebRTC - scalable live stream broadcasting / multicasting

PROBLEM: WebRTC gives us peer-to-peer video/audio connections. It is perfect for p2p calls, hangouts. But what about broadcasting (one-to-many, for example, 1-to-10000)? Lets say we have a ...
igorpavlov's user avatar
  • 3,586
131 votes
12 answers
74k views

What is a "feature flag"?

High Scalability mentions feature flags here: 5 things toxic to scalability, "5. Lack of Feature Flags" What exactly are feature flags?
GurdeepS's user avatar
  • 66.3k
125 votes
7 answers
162k views

A beginner's guide to SQL database design [closed]

Do you know a good source to learn how to design SQL solutions? Beyond the basic language syntax, I'm looking for something to help me understand: What tables to build and how to link them How to ...
110 votes
3 answers
177k views

Best way to store chat messages in a database? [closed]

I'm building a chat app and I want a full history off all messages ever sent in the chat conversation. At the moment I am storing each message as a single row in a table called 'messages'. I am aware ...
wilsonpage's user avatar
  • 17.5k
106 votes
2 answers
55k views

What does scale horizontally and scale vertically mean? [duplicate]

In a three layer architecture with the database on the fourth, what does scaling horizontally and scaling vertically mean?
satish's user avatar
  • 2,445
103 votes
12 answers
133k views

What is the difference between scalability and elasticity?

I've heard many people using both terms interchangeably. However, in my opinion there is difference between them: SCALABILITY - ability of a software system to process higher amount of workload on ...
Miroslav Dzhokanov's user avatar
101 votes
2 answers
27k views

Caveats of select/poll vs. epoll reactors in Twisted

Everything I've read and experienced ( Tornado based apps ) leads me to believe that ePoll is a natural replacement for Select and Poll based networking, especially with Twisted. Which makes me ...
David's user avatar
  • 17.9k
92 votes
8 answers
15k views

How/why do functional languages (specifically Erlang) scale well?

I have been watching the growing visibility of functional programming languages and features for a while. I looked into them and didn't see the reason for the appeal. Then, recently I attended Kevin ...
Jim Anderson's user avatar
  • 3,612
89 votes
1 answer
29k views

Scaling Node.js

I'm fairly new to large-scale server-side development. I want to write a server using Node.js, but before I forge ahead I'd like to know what the general principles are for scaling node up to, say, 20 ...
nornagon's user avatar
  • 15.6k
86 votes
9 answers
84k views

Algorithm for autocomplete?

I am referring to the algorithm that is used to give query suggestions when a user types a search term in Google. I am mainly interested in: 1. Most important results (most likely queries rather ...
StackUnderflow's user avatar
85 votes
7 answers
52k views

Why NoSQL is better at "scaling out" than RDBMS?

I have read the following text in a technical blog discussing the advantages and disadvantages of NoSQL: "For years, in order to improve performance on database servers, database administrators ...
xiaohan2012's user avatar
  • 10.1k
80 votes
6 answers
15k views

Optimizing Kohana-based Websites for Speed and Scalability

A site I built with Kohana was slammed with an enormous amount of traffic yesterday, causing me to take a step back and evaluate some of the design. I'm curious what are some standard techniques for ...
Sampson's user avatar
  • 267k
77 votes
8 answers
166k views

what does O(N) mean [duplicate]

Possible Duplicate: What is Big O notation? Do you use it? Hi all, fairly basic scalability notation question. I recently recieved a comment on a post that my python ordered-list implimentation ...
Fire Crow's user avatar
  • 7,629
73 votes
9 answers
36k views

Should I use EJB3 or Spring for my business layer?

My team is developing a new service oriented product with a web front-end. In discussions about what technologies we will use we have settled on running a JBoss application server, and Flex frontend (...
Justin Standard's user avatar
73 votes
2 answers
39k views

What specifically makes Node.js more scalable than Apache?

To be honest I've not understood it completely yet - and I even do understand how Node.js works, as a single thread using the event model. I just don't get how this is better than Apache, and how it ...
MaiaVictor's user avatar
  • 52.1k
72 votes
9 answers
45k views

Ruby on Rails scalability/performance? [closed]

I have used PHP for awhile now and have used it well with CodeIgniter, which is a great framework. I am starting on a new personal project and last time I was considering what to use (PHP vs ROR) I ...
ryeguy's user avatar
  • 66.2k
72 votes
4 answers
81k views

What does "scalability" mean? [closed]

I read many articles comparing programming languages. There is a word that comes often: scalability. I actually tried to look for a simple and clear explanation, but haven't found anything. Can you ...
Patto's user avatar
  • 739
67 votes
10 answers
57k views

What databases do the World Wide Web's biggest sites run on? [closed]

This question is meant to serve as a list of databases and their configurations that the major web sites use and would be a great reference for anyone thinking of scaling their web site to the size of ...
64 votes
11 answers
25k views

No PHP for large projects? Why not? [closed]

I've read a few posts where people have stated (not suggested, not discussed, not offered) that PHP should not be used for large projects. Being a primarily PHP developer, I ask two questions: What ...
jerebear's user avatar
  • 6,593
64 votes
6 answers
53k views

Can relational database scale horizontally

After some googling I have found: Note from mysql docs: MySQL Cluster automatically shards (partitions) tables across nodes, enabling databases to scale horizontally on low cost, commodity ...
Maksym's user avatar
  • 4,504
64 votes
9 answers
56k views

How to design scalable applications? [closed]

How do you design/architect a scalable application? Any suggestion of books or websites that could help to understand how to scale out applications? Thanks
Martin's user avatar
  • 40k
61 votes
22 answers
9k views

How are you taking advantage of Multicore?

As someone in the world of HPC who came from the world of enterprise web development, I'm always curious to see how developers back in the "real world" are taking advantage of parallel computing. ...
56 votes
9 answers
25k views

How scalable is Parse? [closed]

I've been considering using Parse.com's service for my backend, but I'm skeptical about its scalability. Can it really handle several thousand simultaneous users? If not, is their any good way ...
Rob Caraway's user avatar
  • 3,886
56 votes
1 answer
34k views

Pros and Cons of Sticky Session / Session Affinity load blancing strategy?

One approach to high scalability is to use network load balancing to split processing load between several servers. One challenge that this approach presents is where servers are state aware - ...
urig's user avatar
  • 16.4k
51 votes
7 answers
25k views

Why are Azure Resource Groups associated with a specific region?

I'm new to Azure architecture and am trying to understand why Azure Resource Groups, which are logical deployment buckets for applications built on Azure, are associated with a region when they are ...
Josh's user avatar
  • 4,230
47 votes
9 answers
65k views

Is there some industry standard for unacceptable webapp response time?

There's a cots (commercial off-the-shelf) application that I work on customizing, where a couple of pages take an extremely long time to load for certain distributions of data. (I'm talking ...
Alex Argo's user avatar
  • 8,950
46 votes
3 answers
11k views

How many concurrent users can a web app built in Meteor.js handle? [closed]

We are building a web app which will be used during a contest to vote contestants and display real-time vote statistics on a central display. The contest will last 15 minutes and around 4000 users ...
francesco's user avatar
  • 461
44 votes
3 answers
70k views

socket: Too many open files (24) Apache bench lighttpd

When I start Apache Bench test: ab -n 10000 -c 1300 http://example.com/test.php I get error: socket: Too many open files (24) When I change it to '-c 1000' it works fine. Because I can have more ...
Tom Smykowski's user avatar
44 votes
1 answer
30k views

Websockets and scalability

I am a beginner with websockets. I have a need in my application where server needs to notify clients when something changes and am planning to use websockets. Single server instance and single ...
user3216514's user avatar
44 votes
8 answers
16k views

Extreme Sharding: One SQLite Database Per User

I'm working on a web app that is somewhere between an email service and a social network. I feel it has the potential to grow really big in the future, so I'm concerned about scalability. Instead of ...
Seun Osewa's user avatar
  • 5,013
44 votes
5 answers
19k views

How am I supposed to interpret the results from Apache's ab benchmarking tool?

Alright, I've searched everywhere and I can't seem to find a detailed resource online for how to interpret the results from Apache's ab server benchmarking tool. I've run several tests with what I ...
Nick's user avatar
  • 1,311
43 votes
7 answers
8k views

Does Scala scale better than other JVM languages?

Here is the only way I know to ask it at the moment. As Understand it Scala uses the Java Virtual Machine. I thought Jruby did also. Twitter switched its middleware to Scala. Could they have done ...
johnny's user avatar
  • 19.6k
42 votes
9 answers
50k views

Where does Redis store the data

I am using redis for pub/sub as well as for server side cache. I mean my app server has redis server running as one process (functioning as a cache as well) . I have several thin clients (running ...
user3364247's user avatar
  • 1,487
42 votes
3 answers
46k views

Increasing PHP memory_limit. At what point does it become insane?

In a system I am currently working on, there is one process that loads large amount of data into an array for sorting/aggregating/whatever. I know this process needs optimising for memory usage, but ...
Brenton Alker's user avatar
40 votes
8 answers
16k views

AWS vs Heroku vs something else for scalable platform?

Considering you're a startup with no funds for own server farm. Which existing solution can give you a peace of mind that any sudden increase in traffic won't bring everything down. I know it's not ...
Ska's user avatar
  • 6,818
38 votes
7 answers
11k views

Conflict-free Replicated Data Types (CRDT) vs Paxos or Raft

When is it a good idea to use something like CRDT instead of paxos or raft?
Eric des Courtis's user avatar
38 votes
3 answers
7k views

Stateless Object Oriented Programming vs. Functional Programming?

One of the prime reasons for the increasing shift in attention towards functional programming these days is the rise of multithreading/processing and the advantages of FP's focus on side-effect free, ...
donalbain's user avatar
  • 1,168
36 votes
1 answer
21k views

Celery and Django simple example

Let's take a simple Django example. app/models.py from django.db import models from django.contrib.auth.models import User class UserProfile(models.Model): user = models.OneToOneField(User) ...
Teodor Scorpan's user avatar
35 votes
3 answers
16k views

Are there any REAL advantages to NoSQL over RDBMS for structured data on one machine?

So I've been trying hard to figure out if NoSQL is really bringing that much value outside of auto-sharding and handling UNSTRUCTURED data. Assuming I can fit my STRUCTURED data on a single machine ...
jessedrelick's user avatar
  • 1,337
34 votes
5 answers
9k views

Does the Thundering Herd Problem exist on Linux anymore?

Many linux/unix programming books and tutorials speak about the "Thundering Herd Problem" which happens when multiple threads or forks are blocked on a select() call waiting for readability of a ...
jdkoftinoff's user avatar
  • 2,401
33 votes
8 answers
9k views

How do you scale HTTP server like Google?

I often marvel at how I can go to www.google.com, from anywhere in the world at any time, and get the returned page so fast. Sure, they compress their output and keep to a minimal design - that helps....
Roark Fan's user avatar
  • 682
31 votes
1 answer
8k views

How scalable is distributed Erlang?

Part A: Erlang has a lot of success stories about running concurrent agents e.g. the millions of simultaneous Facebook chats. That's millions of agents, but of course it's not millions of CPUs across ...
G__'s user avatar
  • 7,051
31 votes
2 answers
21k views

System design: Strategies for dealing with heavy writes to a DB

From a systems design/scalability perspective, what are some industry-standard strategies in dealing with a system that requires heavy writes to a particular table in a DB. For simplicity sake, let's ...
user1008636's user avatar
  • 3,059
30 votes
6 answers
15k views

C++ Socket Server - Unable to saturate CPU

I've developed a mini HTTP server in C++, using boost::asio, and now I'm load testing it with multiple clients and I've been unable to get close to saturating the CPU. I'm testing on a Amazon EC2 ...
waterlooalex's user avatar
  • 13.8k
29 votes
4 answers
8k views

Achievements / Badges system

I have been browsing this site for the answer but I'm still a little unsure how to plan a similar system in its database structure and implementation. In PHP and MySQL it would be clear that some ...
bluedaniel's user avatar
  • 2,099

1
2 3 4 5
47