URL

http://opencorporates.com

Twitter

opencorporates

Company's Other Jobs

Click to view

WARNING! This job is awaiting verification or has expired and may no longer be applicable
Category

Software Development

Posted

2013-07-12 20:33

Description

Are you a Ruby on Rails developer who loves working with data? Would you like to use your skills to bring open data to the opaque world of multinational corporations? Would you like to work in a small, innovative, and fast-growing startup environment? If so, OpenCorporates’ new engineer role could be for you.

The data on OpenCorporates comes from a large set of scrapers and importers. Millions of rows of data may be ingested in a single week. Currently, this is done using code we’ve written ourselves. Over the next few months, we have an ambitious plan to create a “data pipeline”, which will allow us to accept scrapers and importers written by third parties. This will allow us to increase our data corpus by several orders of magnitude.

You will be responsible for delivering and managing the new Data Pipeline system, which will include:

  • Developing and documenting the public Data Pipeline API
  • Creating a code ingestion subsystem, covering: ** Moderation workflow *Preflight software checks *Error monitoring and notification **Safe execution environment
  • Creating infrastructure to support discovery of new data
  • Designing data models to support new data types and facts
  • Working with our community-facing developer to write new scrapers and importers
  • Exposing ingested data on public-facing company pages
  • Developing confidence metrics and algorithms

Desirable skills and experience:

  • 6+ years developing complex web software
  • 2+ years developing with Ruby on Rails
  • Experience of working with complex or messy data sets

The role would ideally be based at our offices at the Open Data Institute in London. However, what's most important is talent and a commitment to what OpenCorporates is doing, and remote working may be considered for exceptional candidates. Applicants must have a valid UK work permit. Strictly no recruitment agencies.

Application Info

Please sign in with Google or GitHub to view this job's application information. This is necessary to prevent companies from receiving excessive amounts of spam.

Country

Anywhere*

Location

London or UK

Tramcar - Toronto-Waterloo Region Corridor Jobs