Likes: | nlp nltk wordnet regex python cython c c++ machine-translation machine-learning tensorflow pytorch onnx |
Machine Translation: - Harvests parallel data from various Rakuten businesses - Builds Rakuten's in-house machine translation system
Computer Assisted Language Learning: - Created the automatic quiz generator app algorithm http://languagequiz.viki.com/ (Details https://techblog.rakuten.co.jp/2017/05/26/lang-quiz/) - Upgraded the automatic quiz generator using genetic algorithm
E-commerce NLP / IR: - Developed an unconstrained e-commerce product categorization system
EXPERT project (http://www.expert-itn.eu/) : Using terminologies and ontologies to improve translations. Focuses on building terminology extraction and translation memory retrieval models.
NLP projects: Language identification, NLP for low resource languages, Asian NLP, NLP toolkits developments, Word Sense Sisambiguation and Knowledge Base Population, parallel corpora building/maintenance and usage
Computational Linguistics research assistant: Parallel Corpora building/maintenance, Built NLP preprocesing tools for asian languages, Competed in Semeval-2013 with XLING cross-lingual word sense disambiguation (WSD) system, Collaborated in Knowledge Base Population with NameEntitySuperSense (NESS) sub-module, Head-driven Phrase Structure Grammar engineering
Maintain the backend database and interface for the Erasmus Mundus Language and Communication Technologies Program.
Built the first open version of Nanyang Technological University - Multilingual Corpus (NTU-MC). The NTU-MC is an ongoing effort to produce free and open parallel corpus with languages that are linguistically diverse.
Performing administration work under the Scripture Engagement & Communications Department of Singapore Bible Society. Executed clerical work and assisted activities that Singapore Bible Society organizes. Successfully computerized the department’s address book and completed a project to digitized and replicate the complete collection of John Robert Morrison Bible.
Responsible for the maintenance and installation of the SAF battle system server for 3rd Singapore Infantry Brigade, including LAN technologies, WLAN securities, OS installations, Ethernet systems and confidential battle system
Worked on using topic models to handle crosslingual word sense disambiguation task. Graduated with 5.0 GPA
During my stay in Saarland University, I had took several computational linguistic courses and even built a knowledge base population slot-filler using shallow features extracted from name entities and super sense tags.
Got an good foundation in various subfields of linguistics (syntax, semantics, phonology, phonetics, sociolinguistics, pyscholinguistics, discourse analysis, computational linguistics). The most important lessons I've learnt from my bachelor education is the importance of critical reading and experimental design.
In my final year, I have built a parallel multilingual corpus with diverse languages and applied various NLP tools to automatically annotate the corpus monolingually and crosslingually and provide a sample-based evaluation of some of the annotations.
Stand-alone WordNet API
Python port of Moses tokenizer, truecaser and normalizer
Discriminating between similar languages and language varieties is one of the bottlenecks of language identification. This aspect has been topic of a number of papers published in the last years. The Discriminating between Similar Languages (DSL) shared task aims to provide a dataset to evaluate system's performance on discriminating 13 different languages in 6 groups of languages.
Shared task organizer
Python Implementations of Word Sense Disambiguation (WSD) technologies.
A python implementation of Gale-Church Sentence-level Aligner with variable parameters
By automatically calculating the character mean from a noisy corpora, it is possible to improve sentence alignments.
Deutsch Language Tool Kit -
A collection of basic German NLP tools, tokenizer, compound splitters, etc.
Simple Spanish Tagger using NLTK
A simple tutorial of how one can use the built-in ngram classifiers to build a POS tagger given a tagged corpus
A Dictionary based Chinese segmenter
Using left to right character parsing and a dictionary based mini-square score, it is possible to achieve customized tokenization to scale an NLP pipeline to different variety of Chinese.
Collection of Repackaged Word Embeddings
Yet another Python API to DuckDuckGo Instant Answer API.
Expletives vomiting library...
The XLING system introduces a novel approach to skip the sense disambiguation step by matching query sentences to sentences in a parallel corpus using topic models; it returns the word alignments as the translation for the target polysemous words. Although, the topic-model base matching underperformed, the matching approach showed potential in the simple cosine-based surface similarity matching.
The NTU-MC compilation taps on the linguistic diversity of multilingual texts available within Singapore. The current version of NTU-MC contains 375,000 words (15,000 sentences) in 6 languages (English, Chinese, Japanese, Korean, Indonesian and Vietnamese) from 6 language families (Indo-European, Sino-Tibetan, Japonic, Korean as a language isolate, Austronesian and Austro-Asiatic).
I penned down my internship experience as a travel agent in Vietnam under NTU's Global Immersion Program (GIP) Work and Study Program. My experience in Vietnam is like that of my favourite Pho Tai (Vietnamese beef noodle soup), piping hot; though simple in concept, spiced with exciting snippets.
Traditionally, a language has been analogized to an organism. However linguists have rejected the idea of the organism analogy because it prevented historical linguists from identifying the real cause of language change; the analogy is also inconsistent with the reality of idiolects...
Natural Language Processing (NLP) provides boundless opportunities for solving problems in artificial intelligence, making products such as Amazon Alexa and Google Translate possible. If you’re a developer or data scientist new to NLP and deep learning, this practical guide shows you how to apply these methods using PyTorch, a Python-based deep learning library.