There are many SCM systems out there. Some open, some closed, some free, some quite expensive. Which one (please choose only one) would you use for a 3000+ developer organization with several sites (some behind a very slow link)? Explain why you chose the one you chose. (Give some reasons, not just "because".)
33 Answers
- For such a huge installation, there are at least the following major requirements: Data safety, maturity, robustness, Scalability, price (a per seat licence vs. open source always makes a huge difference regardless of the price per seat), ease of administration
- I would think that subversion would be just fine.
- There is support available (from collabnet, clearvision, wandisco and others). You could ask them if subversion would be able to handle your task.
- subversion has a very mature database backend - FSFS. It is absolutely rock solid and since 1.5 it can handle really many revisions without performance degradation. The revisions are written in a file system. So the reliability of your subversion repository depends on the quality of your file system, os and storage system.
- This is why I would recommend Solaris 10 with ZFS as the file system. ZFS has really great file system features for production systems. But above all it provides data integrity checksumming. So with this amount of source code in the subversion repository you won't have to worry about repository corruption because of a silent hard drive bit error or controller or cable bit error. By now ZFS is mature enough that it can be safely used as a UFS or whatever replacement.
- I don't know about the hardware requirements. Maybe Collabnet could give you advice.
- But a really good start (which could be used as NFS storage or backup storage if it turns out to be too slow - you will definitely be able to make good use of it anyway) would be a 2nd generation thumper, i.e Sun Fire X4540 Server: You can have (all within a nice 4U Rack Server for 80.000$ (list price - this will be likely negotiable)): 48 TB Disk space!, 8 AMD Opteron CPU cores, 64 GB RAM, Solaris 10 preinstalled, 3 year Platinum software and hardware support from sun. So the mere hardware and support price for this server would be 25$ per seat of your 3000 Developers.
- To assure really great data safety, you could partition the 48 hard drives as follows: 3 drives for the operating system (3-way Raid-1 mirror), 3 hot spares (not used, on stand-by in the case of a failure of the other drives), a zfs pool of 14 3-way Raid 1 mirrors (14*3=42 drives) for the subversion repository. If you would like to fill the 14 TB ZFS Raid space only by 80% then this would be approximately 10 Tebibyte of real usable disk space for the repository, i.e. an average of 3 GB per developer.
- With this configuration: Subversion 1.6 on a Sun x4540 thumper with 10 TiB 3-way Raid-1 ZFS redundant and checksummed disk space this should be a really serious start.
- If the compute power isn't enough for 3000+ developers than you could buy a beefier server which could use the disk space of the thumper. If the disk performance is too slow you could hook up a huge array of fast scsi drives to the compute server and use the thumper as a backup solution.
- Certainly, it would make sense to get consulting services from collabnet regarding the planning and deployment of this subversion server and to get platinum support for the hardware and solaris operating system from sun.
- Edit (answer to comment #1): For distributed teams there is the possibility of a master-slave configuration: WebDAV-Proxy. Each local team has a slave server, which replicates the repository. The developers get all checkouts from this slave. The checkins are forwarded transparently from the slave to the master. In this way, the master is always current. The vast majority of traffic is checkouts: Every developer gets every checkin any developer commits. So the checkout traffic should be 99.97% of the traffic with 3000 developers. If you have a local team with 50 developers, the checkout traffic would be reduced by 98%. The checkins shouldn't be a problem: how fast can anybody type new code? Obviously, for a small team you won't buy a thumper. You just need a box with enough hard drive space (i.e. if you intend to hold the hole repository 10TB). It can be a raid5 configuration as data loss isn't the end of the company. You won't need Solaris either. You could put linux on it if the local people would be more comfortable with it. Again: ask a consultant like collabnet if this is really a sound concept. With this many seats it shouldn't be a problem to pay for a one time consultation. They can set up the whole thing. Sun delivers the box with solaris pre-installed. You have sun support. So you won't need a solaris guru on site, as the configuration shouldn't change for the next years. This configuration means that
- the slow line from the team to the headquarter won't be clogged with redundant checkout data and
- the members of the local team can get their checkouts quickly
- it would dramatically reduce the load at the thumper - this means with that configuration you shouldn't have to worry at all whether the thumper is capable of handling the load
- it reduces the bandwidth costs
- Edit (after the release of the M3000): A much more extreme hardware configuration targeted even more towards insane data integrity would be the combination of a M3000 server and a J4500 array:
- the J4500 Storage Array is practically a thumper, but without the CPU-power and external storage interfaces which enables it to be connected to a server.
- The M3000 Server is a Sparc64 server at a midrange price with high end RAS features. Most data paths and even cpu registers are checksummed, etc. The RAM is not only ECC protected but has the equivalent of the IBM Chipkill feature: It's raid on memory: not only single bit errors are detected and corrected, but entire memory chips may fail completely while no data is lost - similar to failing hard drives in raid arrays.
- As the ZFS file system does CPU-based error checksumming on the data before it comes from, or after it goes to the CPU, the quality of the storage controller and cabling of the J4500 is not important. What matters are the bit error prevention and detection capabilities of the M3000 CPU, Memory, memory controller, etc.
- Unfortuntely, the high quality memory sticks sun is using to improve the quality even more are that much expensive that the combination of the four core (eight threads) 4GB Ram M3000 + 48 TB J4500 would be roughly equivalent to the thumper, but if you would like to increase the server memory from 4GB to 8, 16 or 32 GB for in-memory caching purposes, the price goes up steeply. But maybe a 4GB configuration would even be enough if the master-slave configuration for distributed teams is used.
- This hardware combination would be worth a thought if the source code and data integrity of this 3000 developer repository is valued extremely highly by the management. Then it would also make sense to add two or more thumpers as a rotating backup solution (not neccessary to protect against hardware failure, but to protect against administrator mistakes or for off-site backups in case of physical desasters).
- As this would be a Sparc and not a x86 solution, there are certified Collabnet Subversion binaries for this platform available freely.
- One of the advantages of subversion is also the excellent documentation: There is an excellent book from O'Reilly (Version Control with Subversion) also available for free as a PDF or HTML version.
- To sum it up: With the combination Subversion 1.6 + Solaris 10 + 3-way-raid-1 redundant and checksummed ZFS + thumper + master-slave server replication for local teams + sun support + collabnet/clearvision/orcaware/Karl Vogel consultation + excellent and free subversion manual for all developers you should have a solution which provides
- Extremely High Data Safety (very important for so much source code - you do not want to corrupt your repository, bit errors do happen, hard drives do fail!) You have one master data repository which holds all your versions/revisions really reliably: The main feature of source control systems.
- Maturity - Subversion has been used by many, many companies and open source projects.
- Scalability - With the master-slave replication you should not have a load problem on the master server: The load of the checkins are negligible. The checkouts are handled by the slaves.
- No High Latency for local teams behind slow connections (because of the replication)
- A low price: subversion is free (no per seat fee), excellent free documentation, over a three year period only 8$ per seat per year hardware and support costs for the master server, cheap linux boxes for slaves, one-time consultancy from collabnet et. al., low bandwidth costs because of master-slave-replication.
- Ease of administration: Essentially no administration of the master server: The subversion consultant can deploy everything. Sun staff will swap faulty hard drives, etc. Slaves can be linux boxes or whatever administration skills are available at the local sites. Excellent subversion documentation.
-
Good thorough answer. However, you did not address the issue of Large Distribution. Some teams are behind a slow link and would work faster if the network latency would be avoided. Sep 20, 2008 at 20:28
-
SVN was designed to work using slow network connections. I have to use dial-up sometimes and it works well, its compressed diff-based system used to transfer data is efficient.– si618Feb 26, 2009 at 2:42
-
-
3I used to think SVN worked well with slow network connections...until I used Git :)– davrJun 9, 2010 at 23:50
-
3And I thought the times were people actually advocated for SVN are long over. I'm horrified.– julxApr 24, 2011 at 18:31
Having worked at a few companies with 1000+ workers, I've found that by-and-large, they all use Perforce.
I've asked "Why don't you use something else? SVN? Git? Mercurial? Darcs?"- and they've said that (this is the same for all of the companies) - when they made the decision to go with Perforce, it was either that, or SourceSafe, or CVS - and honestly, given those three choices, I'd go with Perforce, too.
It's hard for 'more difficult' version control systems to gain traction with so many people, and a lot of the benefits of DCVS are less beneficial when you have the bulk of your software teams working within 18 feet of one another.
Perforce has a lot of API hooks for developers to use, and for a centralized system, it's got a lot of chutzpah.
I'm not saying that it's the best solution- but I've at least seen some very large companies where Perforce works, and well enough that it's almost ubiquitous.
-
Sure, if you can only choose Perforce or SourceSafe I'd use Perforce too. Or manual SCM for that matter. SourceSafe is one of the worse SCM I've had the displeasure to work with. However, why perforce instead of CVS? Sep 15, 2008 at 18:46
-
2I think the mentality of large dev shops is also that Perforce is profesionally supported (I too worked for a couple). When the auditors come by they feel uncomfortable saying that their engineering backbone is built on an OpenSource project. Perforce feels safer to people who don't know better.– SimonOct 3, 2008 at 21:19
Git was written for the Linux kernel, which might be the closest example to such a situation you can find public information on.
I want to say git, but don't think a company of that size is going to be all Linux (Windows support for git still sucks). So go with the SCM that Linux used before git i.e. BitKeeper
-
I dunno... I use git for windows (with msysGit) and it works nicely. It has a 2GB repo limit at the moment, but I haven't hit that roof yet.– SpoikeOct 29, 2008 at 7:15
As of 2015, the most important factor is to use a Distributed Version Control System (DVCS). The main benefit of using a DVCS: allowing source code collaboration at many levels by reducing the friction of source code manipulation. This is especially important for a 1000+ developer organization.
Reducing Friction
Individual developer checkins are decoupled from collaboration activities. Lightweight checkins encourage clean units of independent work at a short-time scale (many checkins per hour or per day). Collaboration is naturally handled at a different, usually longer, time-scale (sync with others daily, weekly, monthly) as a system is built up in a distributed organization.
Use Git
Of the DVCS options, you should likely just use Git and take advantage of the great communities at GitHub or Bitbucket. For large private organizations, internal community and internal source code hosting may be important (there are vendors selling private hosting systems such as Atlassian Stash and probably others).
The main reason to use Git is that it is the most popular DVCS. Because of this:
Git is well-integrated into a wide range of development toolchains
Git is known and used by most developers
Git is well-documented
Or Mercurial
As an alternate to Git, Mercurial is also very good. Mercurial has a slightly cleaner, more orthogonal set of commands than Git. In the late 2000's, it used to be better supported than Git on Windows systems mostly due to having core developers that cared more about Windows.
GUI
For those who would like to use a GUI instead of git
and hg
on the command line, SourceTree is a great Windows and OS X application that presents a clean interface to both Git and Mercurial.
Obsolete Recommendations
As of 2010, I recommended Mercurial with TortoiseHG. It is the best combination of Windows support and distributed version control functionality.
From 2006-2009, I recommended Subversion (SVN) because it is free and has great integration with most IDEs. For those in the organization who travel or prefer a more distributed model, they can use Git for all their local work but still commit to the SVN repository when they want to share code. This is a great balance between a centralized and distributed system. See Git-SVN Crash Course to get started. The final and perhaps most important reason to use SVN is TortoiseSVN, a Windows client for SVN that makes accessing repositories a right-click away for anyone. At my company, this has proven a great way to give repository access to non-developers.
-
-
1git-svn has some serious problems when used with Windows. The line ending issues could make a grown man cry and unless you've got consistent tools for all users it can be a huge pain. Git on Windows is still generally not polished but it's getting better.– toholioJul 16, 2009 at 1:42
Any DVCS (BitKeeper, git, Bazaar, Mercurial, etc) because being distributed will cut down the load on the central 'canonical' SCM server. The caveat is that they're fairly new technology and not many people will be familiar with their use.
If you want to stick to the older, centralized model, I'd recommend Perforce if you can afford it, or Subversion if you don't want to pay for Perforce. I'd recommend subversion over CVS because it's got enough features to make it worthwhile but is similar enough that devs who already know CVS will still be comfortable.
First, big NO on CVS. Using CVS in 2008 is like driving a 92 Isuzu Trooper. The only reason they are on the road, and that people spend money to maintain them, is for purely sentimental reasons. CVS is old hat, technology-wise, and you will regret it.
I'd generally steer away from open source tools in that size of a company, too. Subversion is an excellent little tool and is pretty solid, but on the off chance that you go down or run into a bug you were unaware of, the onus is on you to fix it while 3,000 people sit idle. Perforce is cheap when put in that perspective and I highly recommend it.
It surprises me how many people that purport to be SCM professionals go with 'free'. On the surface it looks great to managemnt but when you're under the gun it helps to have a high-quality support team on your side. When you get woken up at 3am on a Sunday because your team in Singapore can't do any work, you won't be thinking 'free' was a good idea.
Source control tools are mission critical, you're talknig about company assets and intellectual property. Do not skimp on source control tools, ever!
-
1Funny you should say that: the fact that it's open source is usually a boon. It means that your company or anyone else can fix any bugs which crop up, versus sitting around while the vendor tries to fix it. Anyway, SVN has been out for 8 years now and is regarded as quite stable AFAIK.– nickfSep 16, 2008 at 0:47
-
1How do you recon a vendor can fix a bug in the SCM faster than yourself? A swat team with pre-booking on all flights to all destinations? The "you need someone to fix it for you"-argument does not hold. If I develop software for a living, I surely can fix a bug in my SCM software. Sep 20, 2008 at 20:22
-
2I may be a programmer, but I certainly hope that I don't need to dive into some giant bit of code that I've never seen before to fix an obscure problem! Having a professional technical support team on your side is not something to be shrugged off so lightly. Sep 25, 2008 at 21:54
-
A versioning filesystem like zfs underneath the source repository might not be a bad idea (in addition to backups). If the source repository breaks, just find a filesystem snapshot where it was ok. When THAT is said - every release which has gone to a customer should have a build server artifact containing the exact source used to build that code. Oct 25, 2009 at 18:29
-
3It might be helpful to cite any actual occasions where someone was woken up at 3am to help work around a bug in Subversion. This seems very unlikely to happen. Same with git. Jun 14, 2010 at 7:47
Summary: of the systems I've had personal experience with git would handle this the best.
Detail:
I've worked at several large companies with lots of developers. At a prior job (I would guess around 500 devs) we used (because of the era) RCS and CVS. Another group also used ClearCase. The ClearCase group had significant problems, but I never knew if it was due to ClearCase or misuse of whatever the ClearCase methodology should have been, or a poor ClearCase admin staff.
At the company I'm with now (well in excess of 10000 devs, but I doubt more then 1000 are on what most people would think of as a single project, although they ARE that many on a single product), we have used CVS (for historical reasons), SVN (because it was an easy migration path), SVK (nice at the time, but I wouldn't recommend it), Mercurial (sorry, no direct experience), Perforce (ditto), and Git.
Unless you get warped into the past and trapped there I wouldn't recommend RCS or CVS. They had nice points, but compared to more modern version control systems they have nothing to recommend them.
SVN is stable and mature, and branching is way way way faster then CVS (seconds not minutes for a large project). However merging those branches in is still a little primitive (in simple cases a little shell script can make it pretty easy, but if a branch got updated and had stuff pulled in that was also committed elsewhere it is very hard to manage). SVN source repos also seem to need more care and feeding then any other open source repos (but less then the commercial ones seem to take). SVN has a nice simple conceptual model.
However you have "several sites (some behind a very slow link)", SVN works for that, but doesn't work all that well for it. It is not only slower for the people at the "slow site", but while the "slow site" people do some operations everyone else is locked out. Despite that I would say SVN works well for groups that have fairly good (fast and reliable) access to the central repo.
SVK worked much better for our "slow sites" (and allowed significantly more "detached work"). It also worked much better for complex merges then SVN. SVK is no longer maintained, otherwise I would recommend it.
Git is relatively young for a huge enterprise to be seriously considering, but that aside…
It does a good job BUT has a fairly steep learning curve. More so to groups that already use a centralized source control system. One thing that helps here is to formalize things like "X is the authoritative repo for project Y" and take all your old review processes and such and apply them to that repo (if you use to need a code review from R and a sign off that tests T passed before checking into your old source control system's trunk, require the same things before doing a commit to the authoritative repo's master branch).
In some ways git actually works better for large groups then things like SVN. You can enforce process by having only a small number of people able to commit to whatever repo you designate as authoritative. Those people can be responsible for ensuring all the "process" has been followed before they pull changes into the repo. Git will even keep track of who made the changes vs. who integrated them (something that SVN seems to get wrong a lot of the time).
Git makes it even cheaper then SVN to create branches (you can do it disconnected, and it is less then a second vs. maybe 3 seconds on SVN), but while most people claim that as a huge deal it isn't. The big deal is the merges are very very easy. Even in cases where you have done things like started a branch, done half the work, had to work on something else for a month, update the source in your branch because other people have changed the base project over the month, then done the second half of the work, got sidetracked, had to come back later found out that there was a 3rd half of the work, more external updates, and so on… …even after all that the merge figured out what stuff was really new in your branch vs. came in from your updates and keep the amount of stuff that really needs merging to a minimum.
There are a lot of things I dislike about git, but they almost all come down to "some of the tools are sharp and you should be careful". Things like a lot of the operations that don't exist in things like SVN should only be done on commits that only exist in your repository (don't edit history others have seen!). Other source control systems have similar issues, but git has more emphasis on editing history to kept it "clean", so there are more tools and options to tools that you either need to ignore, or know when it is safe vs. a disaster. On balance I find it superior to other version control systems I've used.
My second hand info about Perforce is "it is kind of better then SVN and kind of not". My second hand info about Mercurial is "it is more or less like git except in the details, some like it better others like Git more".
Of corse at a company with 1000+ developers I would recommend that you get a support contract for whatever source control system you use. For git I would look at github:fi.
Do not use CVS!! If you want the CVS model, Subversion is a much better alternative.
Okay, outright disclaimer: I'm a developer for a company called MKS which makes a version control system for "enterprise" companies as part of a software configuration management platform called Integrity. Blah blah blah, obvious plug.
So I can't honestly answer the question.
However, I'd like to point out that people suggesting distributed version control are missing something screamingly important for large companies. For them, it's less important how much flexibility developers have when dealing with their version control system than it is that they have absolute control over every line of code that gets shipped. Regulatory conformance and audits are a way more central concern than how painful merges are.
A company with 1000+ developers wants to know that everybody is doing what they're supposed to do and that nobody is doing what they're not supposed to do, everything is tracked and managers get lovely reports and graphs they can paste into PowerPoint slides for their managers.
If a large company doesn't particularly care about those things, they're far more likely to leave it up to individual dev teams to figure out their own thing, in which case, 1000+ developers are using a hodge-podge of different tools based on whatever seemed most convenient at the time.
-
3@Darcy You can enforce regulatory conformance and audits on a DVCS. Practically you have a central repository that a commite pulls in changes to from proposed patches. Those 1000+ developers can then have their own repository without littering the central one and still have the benefit of DVCS.– SpoikeOct 29, 2008 at 7:11
-
1That is also how most well organized OSS developers work. You can't beat how the whole world works compared to measly 3000+. ;)– SpoikeOct 29, 2008 at 7:12
-
1It's not so much a technical limitation as a mindset difference. In some cases, we're talking about very restricted environments. The word "distributed" in those situations alone is enough to scare these people off. Oct 31, 2008 at 22:37
-
2Only code build by the build server can go to the customer... Oct 25, 2009 at 18:29
-
I know that and you know that, but we're not the ones who are scared. These people aren't developers. These are people who are very concerned about things like traceability and auditory compliance. People promoting DVCSes need to speak their language. Oct 26, 2009 at 20:59
If you have such a large organization then do not mandate a single specific SCM.
I am sure they are not all working on the same code and it would be worth while to let the teams themselves choose what they are most comfortable with.
(You may need to provide some training so the understand how to choose between Git, SVN, some internal legacy system.)
-
This may be a good choice when developers work in different products. In my case they are all working on the same product (albeit different components). To escape the Conway's law curse (w.cx/cfe109), you want to organize around feature teams => developers need to access the whole code base. Sep 15, 2008 at 19:20
Perforce
What I like about perforce say compared to CVS is that the branch management is must more sophisticated (but still reasonably easy) and you don't need to bug a central bureaucracy to create branches/labels and the like. In other words it allows to an individual team (or developer) to manage their source components how they like, before submission to a mainline centrally administered by someone else.
Oh, I'd also say it has one of the best GUIs out there whilst still having a 1st class citizen command-line interface. I normally hate GUIs but theirs works.
-
P4Win was rock solid. P4V is plain buggy. I'm using a 2008 release of it now, because all newer versions until the latest 2010 release have bugs that make the tool misbehave in our environment.– MaxVTAug 23, 2010 at 15:00
I would use bitkeeper. I've used bitkeeper, clearcase, accurev, perforce, subversion, cvs, sccs and rcs, and out of all of those bitkeeper was far and above the best. I've toyed with git and was impressed by its speed, but I thought its UI was a little cumbersome (though that opinion was formed after only using it for a couple of half-days).
bitkeeper has rather clunky looking GUIs but they are exceptionally functional. The bitkeeper command line tools are arguably best-of-breed and its merge capabilities were absolutely fantastic.
What I most liked about bitkeeper (and this is probably true of all distributed systems) is that branches were dirt cheap. Creating branches was a way of life rather than something to dread.
If you have 1000+ developers working on a single piece of software, you have the resources to invest in a lot of tooling of your own. Whatever you choose, you'll probably do plenty of work to adapt it to your situation.
Microsoft's Team Foundation Server is used within Microsoft on some very large teams, and the TFS team is working on making it scale up well. Also, the integration of source control & bug tracking is attractive. It's not cheap, and administration is enough of a hassle that it doesn't scale down well to small teams, but for your situation, you can afford those costs. You probably also want to be able to call on a large support organization like Microsoft has when you get in to trouble (but if you go with free software, then you have the option of doing that support in-house).
If you have 1000+ engineers in your company, but they are working on pieces of software that ship separately, I think you'd want to put each one on its own server. This makes performance scale better, as well as administration. I would insist on having just one technology for source control, however.
-
2MS tools only work if you develop for windows only. Most of the developers out there in the world do not have that luxury. Cross-platform support is here to stay... Sep 20, 2008 at 20:24
I would use AccuRev. I've used svn, cvs, clearcase (base, ucm), ccc/harvest, but none of them can beat AccuRev's strengths. "3000+ developer organization with several site"? you can use Accurev distributed solution (AccuReplica) for that - which mean you have one single master server and as many as you want replicas on remote sites (so those with the "slow link" won't suffer much)
Above all AccuRev brings a unique approach - a truly new concept/design/implementation of stream-based SCM tool. Not in the (bad) way ClearCase-UCM did that (because ClearCase "streams" were eventually branches), but in slick modern way.
The best is to try it yourself, I know that they offer a trial of 30 days with enough licenses to toy with the tool - try it and you won't want to consider other tools. My promise.
I doubt whether you have 3000 developers in your organisation all working on the same code base. I work for a medium-large software company, and we probably don't have that many in the entire company, but there are also many independent projects.
Internally some groups deliver releases to other groups to use in their products; this is not managed through a SCM system.
Our own group has its own SCM but there are only about 25 active developers. We use CVS, and to be quite honest it's not really up to it (we'd migrate but have a lot of scripts / commit hooks and other bits & pieces which need a lot of work to change). The problem with using CVS on a reasonable size code base is that many operations are very slow and involve locking other developers out.
I'm horrified that most of the people here advocating for DCVS-es here are taken as some kind of fanboys. DCVS-es are rendered as yet another buzzword just like say cloud computing, social media, etc.
Some people here are advocating for usage of SVN along with some specific hardware setup, specific disk storage that is supposed (or even is capable of) bringing reliability to the table. Now isn't that just defeating one of the two main purposes of an SCM - namely ensuring data integrity?
You don't have sufficient information on the data storage level to ensure integrity of the whole source base across all the past revisions. What if you wish to migrate the data onto another machine? What if you want to migrate it gradually without stopping all development until it's done? What if there is a security issue and somebody messes up with your main copy? How do you find the last valid one? Storage integrity gets you only that far, and will give you no means to solve any of those issues. It's exactly because it operates on an inappropriate level of abstraction. Is not the storage you're concerned with. It's your code base.
Another issue. Some people can't believe it's actually possible for 3000+ people to operate within the same project. They say "go and bake your own scm", which I imagine is another way of phrasing "yea... right... 3000+ devs... good luck with that". At the same time there are projects that involve many more people. Take just about anything from engineering to law. But somehow when it comes to software development it's impossible, it can't be. The thought (I imagine) goes something like this: What? 3000+ people touching the same file? Now, that can't be. And, yea it's correct. It can't be. The question is why would you ever let 3000+ people touch the same file? Where in nature would you ever find such situation? Do 3000+ lawyers send each other a single document until they eventually agree on everything? People don't work like that. It's never possible to work in reality like that. Yet a centralized CVS theoretically makes it possible. Even worse it forces people to actually coordinate their work with individuals they don't even know. In such situation it's not even an issue of having smart people on board, although out of thousands of people I imagine it's quite hard to guarantee that each and every one of them is not an idiot. It's simply about making common stupid mistakes. Everybody commits errors (literally). Why would you suddenly like to inform the entire company about it?
Now some may say - but you don't have to give commit access to everybody. Well - that's cheating. It's exactly a hopeless attempt to build a distributed work flow in a centralized environment. Suddenly you have a two level tree - people with commit access send the work by all those, who don't. Well if you went that far, why not just agree on the inevitable - that there isn't and never will be just a single common version of the whole source base. That people need to work within their detached environments that can be than easily merged together.
There are many DCVS'es these days. Only Git has this approach of tracking content and not individual files, which in this case might not be an optimal choice (however it very much depends on the organization of the project). There is also Mercurial, there is Bazaar. So the two properties don't depend on each other.
I don't really want to recommend any specific DCVS out there, I don't feel that competent. However in a situation where most of the recommended solutions are not distributed, don't ensure data integrity, are actually worse than not having any CVS at all, I felt like I need to write something. The question really should be which DCVS is best fit for doing the job.
I'd use any SCM that does not have pessimistic locking ( http://old.davidtanzer.net/?q=node/118 ) mechanisms. Especially because you want people to be able to "edit" the same file at the same time in any sizable project.
Personally I'd choose SVN with some solution for distribution, but since in SVN you only submit what you change (which should be very little for each commit anyway), the network overhead is very small. Also the server load can be handled with more hardware to some point. I have not yet found the ceiling for hardware scaling when using SVN.
Other choices may include "git" which the Linux Kernel people use, but I don't really have any experience with that.
Adobe uses Perforce
-
But isn't Perforce a pessimistic lock (see davidtanzer.net/?q=node/118)? That is a very bad pattern in a largely distributed organization, at least if you want someone to be able to edit the same file at the same time and be able to resolve the merge later (if needed!). Sep 15, 2008 at 18:39
-
Perforce does not use pessimistic locking by default. It does support both types of locking described in that article. You can lock files if you really want to, but it is not the default behavior upon checkout.– ravenSep 15, 2008 at 18:49
-
Perforce is a decent system, and scales well.
I'm working at an organization of about 5000 employees, and perforce is a fast and efficient system. It scales well, has good branch support, has atomic commits. Each change has a change number that can be used for "software archaeology" and a host of other great features.
Additionally, it has good support for windows, mac and unix, including good command line and has good script support.
I've used CVS before, and it doesn't scale well to groups greater than about 25-50 engineers (mostly because of atomic operations and performance)
-
Most SCM's have atomic commits (w.cx/e5), Perforce is no better Are you been able to comfortably use Perforce when more than one developer needs to edit the same code? Do you synch commits via email? Since perforce "locks" every checked out file this can be a real problem if code is shared. Sep 15, 2008 at 19:56
If you mean 3000+ developers wokring on the same codebase, i've got no clue. If you mean working on several hundred projects on different locations and you need to have a standard, I'd go for somethins popular with a massive online user support i.e not something obscure that gives you 10 hits on Google.
Personally I would settle for SVN, I'm on an IT dep with several hundreds of devs and the preferable source control app there is SVN.
:)
//W
I would actually check out Team Foundation Server. It is a very good system that can scale and it is probably easy to get through internal it departments. I know it is Windows centric but you can use add-ons for Linux/Mac also and you can use proxies for some sites with slow connections.
And I would think about having 2 systems in a large organization, it may help getting the best in some separate cases.
Perforce and TFS are the only options that I know of. I know that both of them have been used on large scale projects within Microsoft. Vault may scale that big, but I don't know if it goes beyond 500-1000 users.
Perforce is proven to be scalable to 5000+ users on a single server at Google, see: Life on the Edge: Monitoring and Running a Very Large Perforce Installation
It would seem that many of the largest software companies use Perforce either exclusively or as their main SCM. For example: Adobe, Cisco, SAP, Symantec, EA, UbiSoft and Autodesk are all Perforce users. It's not perfect but it's still superior to SVN or TFS (Neither of which is bad in it's own right)
-
I take issue with that last statement. You have not explained why Perforce is "superior". If you look at it from a largely distributed team that needs to edit the same code, Perforce is certainly NOT superior in any way. See "Pessimistic Locking". Sep 20, 2008 at 20:26
-
Sorry, but do believe you are wrong on the locking issue. Perforce only enforces pessimistic locking on text files if you explicitly tell it to, all binaries are pessimisticly locked by default, you can also define a list of file types that will be pessimisticly locked upon open. The file list is flexible down to the file level.– Ausmith1Jul 31, 2009 at 23:39
Perforce gets my vote as well. I've not used it on such large projects, but it's absolutely rock solid in my environment. It also has an impressive resume of large projects, as well.
[rumor]I've heard tell that Microsoft used it for Vista.[/rumor] Apparently it was a customised version for them, but it doesn't get much bigger than that.
-
Microsoft used Source Depot, which is a Microsoft-specific cousin of Perforce.– BrannonSep 16, 2008 at 5:43
Let's see the options.
1 - Perforce. Used by lots of companies (as people said there) Adobe, Amazon, MS, Google Companies who grew, advanced, and depend on selling software everyday to put food on the table, that's their choice. I guess that's the way I would go if I needed a supported "global solution" for a multitude of sites, etc Good for Win/Linux (not sure about Macs though)
2 - SVN. Used by big teams as well, KDE uses it (huge, huge project) currently in revision 880,000 (yes!) Very practical for both Windows and Linux usage (even though I would call TortoiseSVN below average in some aspects) Commercial support can be contracted as well. Good for Windows / Linux / Macs as well.
3 - Accurev If I was trying to be "edgy". I wouldn't deploy it on the whole company without some testing and getting used to it first.
4 - MS Team Foundation It may be a good solution but I never tried and is probably Windows only.
5 - Git / Bzr / Hg - Bzr and Hg have their "tortoises" so, good for Windows (even though I'm not sure about maturity) Git would be linux only for the time being, even though it is VERY GOOD (and much better and easier to use than a couple of years ago).
I would NEVER, EVER, ABSOLUTELY No WAY JOSE use Clearcase. PERIOD It is a waste of everybody's money and time and sanity.
Steer clear of: CVS / Clearcase / anything older
If they're all working on the same product, probably Perforce.
If there are lots of smaller projects (2 to 50), I'd run several Subversion (SVN) boxes.
Subversion is easy to scale and split up. Perforce costs thousands of dollars for only a handful of employees, way to expensive, and besides, it offers nothing that subversion does not offer.
Subversion is really easy, better than cvs.
I would have recommended git if only their windows support was better
-
Your statement leads me to believe that you 1. have not explored the full Perforce functionality yet (e.g. the whole branch mapping concept is ingenious) and 2. have not yet worked as an integration manager in a large-scale development environment.– sscFeb 22, 2010 at 23:04
-
I would never ever pick perforce to do anything. Git, Mercur, fossil and more version control systems have much better branching and everything else. I will say to though that Perforce has excellent service. But this is 16 months old comment you are commenting on, which makes me believe you are a troll Feb 23, 2010 at 15:10
in our company we use alienbrain but we are migrating to Perforce. Perforce has everything you want: it hadles code and data, he integrates tools for continuous integration, it handles local (per developer) repository so you can check-in in your local repository before committing on server.
I vote for Perforce