Data Engineer

Category:
Information Technology
Industry:
Oil & Gas
Type:
Direct Hire
Location:
Houston, Texas
Job ID:
#158059

Our client’s Technology + Innovation Lab works with data that powers their products to improve safety and reliability. By working hands-on with ground-breaking technology, the lab pioneers the development of innovative products through small agile teams. Their teams incorporate a variety of multidisciplinary skills, including industrial predictive algorithms, machine learning, and sentiment analysis.

As a Data Engineer, you’ll help ingest, transform and store clean and enriched data in ready for business intelligence consumption.

Who you are

  • You’ll have experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
  • You build and maintain optimal data pipeline architecture.
  • You assemble large, complex data sets that meet functional / non-functional business requirements.
  • You identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, data quality checks, minimize Cloud cost, etc.
  • You build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Data Bricks, No-SQL
  • You build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • You document and communicate standard methods and tools used.
  • You work with other data engineers, data ingestion specialists, and experts across the company to consolidate methods and tool standards where practical.
  • You’re experienced using the following software/tools:
  • Big data tools: Hadoop, HDI, & Spark
  • Relational SQL and NoSQL databases, including COSMOS
  • Data pipeline and workflow management tools: Data Bricks (Spark), ADF, Dataflow
  • Microsoft Azure
  • Stream-processing systems: Storm, Streaming-Analytics, IoT Hub, Event Hub
  • Object-oriented/object function scripting languages: Python, Scala, SQL

What you’ll do

  • You’ll work independently on complex data engineering problems to support data science strategy of products
  • You’ll use broad and deep technical knowledge in the data engineering space to tackle complex data problems for product teams, with a core focus on using technical expertise
  • You’ll improve the data availability by acting as a liaison between Lab teams and source systems
  • You’ll collect, blend, and transform data using ETL tools, database management system tools, and code development
  • You’ll implement data models and structures data in ready-for business consumption formats
  • You’ll aggregate data across various warehousing models (e.g. OLAP cubes, star schemas, etc.) for BI purposes
  • You’ll collaborate with business teams and understand how data needs to be structured for consumption

How you’ll work

  • You’ll be based in an office environment with occasional travel to other Lab locations
  • You’ll be part of a pressurized environment, working to tight deadlines

This company builds advanced technology products to deliver energy in a safe and reliable way to fuel a rapidly innovating world. In their new Technology + Innovation Lab they believe in Agile way of working, focus on their people and value craftsmanship, in a ‘work is play’ environment where they offer a flexible, fun, and modern working style to support individual needs.

Apply now to start a career with unlimited potential!

 

EWEMI