Data Mining Engineer at Scribd
- Posted 18 days ago
About this job
Job description
The Job
Are you passionate about artificial intelligence, data mining, and the web? Wondered what it would have been like to join Google in the early days? We may have the role for you.
Scribd is building a new team to tackle a still-confidential project that involves crawling a large subset of the web and mining it for structured data. This is an engineer's playground of interesting technical problems and a great opportunity to get involved at the ground floor of a new product.
Skills & requirements
The Ideal Profile
We're looking to add people with varied experience levels, from seasoned veterans of web crawling to talented engineers who can learn fast and would like to try something new.
The ideal candidate is someone who loves the web and web technologies, but rather than continuing to build their own sites is interested in helping to make the web more useful by understanding the data already there. Building a great web crawling operation is a combination of formal artificial intelligence techniques, system scalability problems, and clever heuristics with a helping of good judgement. For the right person, this should sound like a really fun problem.
Responsibilities
-Work with team to develop software that can mine structured data from the web
-Continually test, refine, and improve the accuracy of extraction technology
-Develop and scale a distributed web crawling engine
-Use a combination of formal and heuristic techniques to cover the largest possible set of cases with the minimum amount of effort
Qualifications
-Strong understanding of web technologies - HTML, CSS, Javascript
-Strong overall engineering background - as evidenced by a degree in CS or equivalent industry experience
-Follow technology trends and have an understanding of the overall web ecosystem - web advertising and economics, major players
-Familiarity with artificial intelligence and data mining techniques
-Not an astronaut architect - good at producing simple "just enough" solutions to complex problems
-Ideally: direct experience with web data mining or web crawling
This is a full-time role in San Francisco, CA.
About the company
About Scribd
Scribd is a YCombinator startup based in San Francisco. Our vision is to build the future of publishing, and we're already one of the top 100 sites on the web with over 90 million monthly visitors. We've won lots of awards and raised 20M along the way, but the journey is only 1% finished, and we're looking for talented technologists of all kinds to take Scribd to the next level.
There is a lot of deep technology operating behind the scenes at Scribd. We have scaled the world's second largest ruby on rails site, invented the first HTML5 document reader, and done original work on textual analysis. Scribd is a very engineering-driven company: as an engineer here you will have a lot of responsibility to choose the projects you work on and to define the way they get built. And because we have a large userbase and deploy new code daily, your work will likely be used by millions of people on your first week.
Scribd has a unique company culture that combines a laid-back atmosphere (we have company go-karts and an office zipline) with a total focus on doing great engineering - the best way to experience it is really to read through our jobs page and watch our infamous go-kart racing video (http://www.youtube.com/watch?v=X7CunWyYogA). For more info on our technology, check out our tech blog (http://coding.scribd.com) and this article about our break-through HTML5 technology(http://techcrunch.com/2010/05/05/scribd-html5).
Recently we launched our first mobile application, called Float, for web and iOS. Float is more than just an app, though; it is a digital reading service that aims to bring all of your favorite reading sources into one platform. We're combining news articles, blog posts, books, and more into one integrated reading experience that works across all devices. For more info, check out some of the great coverage we've had (http://www.wired.com/epicenter/2011/07/float-netflix-reading) about Float, or try it out yourself at float.com.