182

I need a database of every single valid word in English. I checked the /usr/share/dict/words file, it contains less than 100k words. Wikipedia says English has 475k words. Where do I get the complete list (American spelling)?

Also, is there a single website that gives out words for other languages too, including Asian and European ones?

Edit: Forgot to add, I do not need names etc., just valid English words.

6

6 Answers 6

94

WordNet database might be helpful. I once worked on a Firefox add-on which deals with words and all kinds of simple to complicated associations between them and stuff. Looks like WordNet will be very much useful to you.

Here it is in MySQL format. And this one (web-archived link) uses Wordnet v3.0 data, rather than the older Wordnet 2.0 data.

10
  • do they have a downloadable list too?
    – user187809
    Feb 6, 2010 at 16:32
  • 1
    Yes, they give you the facility to download their database in a lot of formats - CSV, MySQL Database, etc.. and even have APIs you can use through .Net, Java etc... This is the download page - wordnet.princeton.edu/wordnet/download
    – user266803
    Feb 6, 2010 at 16:41
  • is this the one? wordnetcode.princeton.edu/3.0/WNdb-3.0.tar.gz
    – user187809
    Feb 6, 2010 at 16:44
  • I have not personally downloaded it, but it was there ready when I started coding. So I don't know what files will be there in which download. I just know that you can download in different formats. If you can tell me in which format you want, I may be able to help.
    – user266803
    Feb 6, 2010 at 16:45
  • I installed wordnet, but can't find any command line, is it just a library ?
    – jokoon
    Sep 19, 2011 at 21:30
42

You can find what you need on infochimps.org.

They have a list of 350,000 simple (ie non-compound) words available for free download.

Word List - 350,000+ Simple English Words

Regarding other languages, you might want to poke around on Wiktionary. Here is a link to all the database backups - the information isnt organized so likely but if they have a language, you can download the data in SQL format.

5
  • 6
    The download link has changed - infochimps.com/datasets/…
    – Chris Rae
    Jan 13, 2012 at 15:01
  • 48
    Annoyingly the infochimps file is .xls (an excel file with the words split across 6 worksheets!) ... I've extracted all 354986 words into a txt file: github.com/nelsonic/english-words
    – nelsonic
    Jul 13, 2014 at 22:33
  • 1
    @nelsonic thanks a lot ,the infochimps link is 404
    – user1642018
    Dec 20, 2014 at 10:50
  • 1
    @ChrisRae both links not working
    – garg10may
    May 12, 2016 at 15:24
  • 5
    seems like they include words with misspellings, like tecnology - presumably because they collect everything that shows up on the web. so it's good for password cracking / validation, but not good for applications that require real words (like spell checkers, etc.).
    – max
    Jun 7, 2016 at 2:14
13

I do not see http://wordlist.sourceforge.net/ mentioned here, but that is where I would start if I were looking for something like this (and I was, when I stumbled over this question).

If you cannot find what you want there, and what you want is a list of english words, then you should probably spend some extra time describing how to recognize what it is that you want.

3
  • 1
    I was hopeful that these broader lists would contain words with punctuation, like "C++" or "C#", but couldn't find any. So if that's what you're after you can short-circuit you can skip this one (and the narrower lists in other answers).
    – hobs
    Apr 27, 2016 at 18:53
  • @hobs Technically, "C++" is a C word (more likely from the B language), and not necessarily an English language word. It is actually defined as legal C grammar. True, English has borrowed it, but it isn't from a natural language. Feb 14, 2022 at 14:52
  • @SO_fix_the_vote_sorting_bug I don't think that's true. English is a dynamic, informal language. There is no rigid, logical definition or category theory math expression or software program you can write to identify what is and is not an English word. You must create a statistical model for what you want in your list of words for your application. I think NL is a superset of all languages (formal and informal) because humans use them all to communicate with each other.
    – hobs
    Feb 20, 2022 at 1:41
11

There's no such thing as a "complete" list. Different people have different ways of measuring -- for example, they might include slang, neologisms, multi-word phrases, offensive terms, foreign words, verb conjugations, and so on. Some people have even counted a million words! So you'll have to decide what you want in a word list.

2
  • 3
    Thanks for that link. A very enlightening read on just how many words there are in the English language, and the futility of trying to arrive at a definitive count of them. For a more concise and up-to-date read, there's also this: en.oxforddictionaries.com/explore/language-questions/…. Mar 2, 2017 at 19:30
  • 1
    @HashimAziz The issue is probably that there isn't an objective definition of "English," as it's just a consensus type of thing. One could make a list of "every utterance ever uttered by an English speaker while speaking English." But then you'd have to define "speaking English" and "English speaker." Feb 14, 2022 at 14:46
4

You may check *spell en-GB dictionary used by Mozilla, OpenOffice, plenty of other software.

5
3

You didn't say what you needed this list for. If something used as a blacklist for password checks is enough cracklib might be good for you. It contains over 1.5M words.

3
  • 2
    no, not for blacklist. I am doing some sort of word game/graph.
    – user187809
    Feb 6, 2010 at 15:49
  • 1
    This has a lot of "junk words", however I'm still very grateful that you put this here - it's perfect when searching for specific words that the other dictionaries don't have (e.g. firetruck)
    – kangalio
    Oct 6, 2019 at 15:52
  • @Benjamin Bannier How to extract words from this to something like a txt file? Nov 23, 2022 at 3:51