Brunel uses cookies.
What does this mean for you?

SDLC Developer

Houston - Texas - United States - Oil, Gas & Mining - Oil & Gas - Project Management & Services - Academic Bachelor

Are you a SDLC Developer with experience in Big Data Platforms? Are you looking for a major Oil and Gas Data Solutions company from Silicon Valley?  If so, send your resume today!

Feel free to contact

Meline Silverio, Account manager

Apply now

Job description

Job Description 

  • This position is for a Big Data developer whose primary responsibility will be implementing data ingestion, ETL, and stream processing pipelines to support the data scientists;
  • Employee must be a strong team player with good collaborative skills;
  • While they will be expected to take requirements from data scientists and data managers, the developer is expected to bring their own expertise to determining the most effective, scalable, and architecturally-sound way to meet the team’s needs.

Tasks will include: 

  • Orchestrating the automatic routine acquisition of cybersecurity logs and supporting data; 
  • ETL development to normalize this data and publish it in Impala; 
  • Developing stream data processing pipelines to automate the running and training of machine learning models inside Hadoop. 

About you

Required Experience: 

  • Linux shell scripting: 5-10 years; 
  • Java programming or C++: 5-10 years; 
  • Hadoop (including at a minimum Pig and Hive/Impala; Spark strongly preferred as well): 2-5 years.

Required skills: 

  • 10+ years Java development or C++ experience;
  • 10+ year’s Python experience;
  • 3+ years ETL development experience with Pentaho Data Integration;
  • 5+ years’ experience developing in the Hadoop environment;
  • 3+ years’ experience of application development in Spark;
  • Linux super user comfortable with developing in a Red Hat environment;
  • 5+ years in Java, Scala, JavaScript/HTML5, and Coffee Script.

The following are desirable but not required: 

  • Fluency in Scala;
  • Experience with application/ETL development in the cybersecurity domain;
  • Experience designing and/or implementing large scale data ingestion pipelines for big data applications; 
  • Experience with graph analytics, such as Neo4j.

What we offer

Brunel Energy provides specialist personnel to the international oil & gas, petrochemical, power generation and construction industries. Our clients are predominantly major operating companies and international engineering or construction companies. Through a network of 40 offices in 5 continents (Europe, Americas, Asia, Africa and Australia) we currently second over 8,000 Technical Engineering Specialists to the largest multinational Oil & Gas Companies and major EPC Contractors, through well-established global supply agreements.




  • Contract-to-Hire or Perm, Full-time
  • Competitive wages and benefit package.

About us

Our Client has pioneered the a knowledge-centric technology that has been developed over the past 4 years, while solving the most complex operational challenges of Global Fortune 500 industrial companies. Their Platform turns human expertise and data into digital knowledge for employees to make better and faster decisions.

Their Knowledge Platform expedite extracting knowledge from data silos and information sources, to reveal their relationships in the context of optimizing assets and processes.Their Global Fortune 500 customers, GE, Chevron, Maersk, Saudi Aramco and Shell are increasing profitability by accelerating digital transformation with digital knowledge. This digital knowledge enables employees to make thousands of decisions that optimize key assets and workflows, 3 to 10 times faster than alternative solutions.


  • Vacancy number: PUB157045
  • Location: Houston
  • Market: Oil, Gas & Mining
  • hours per week: 40.0
  • Branche: Oil & Gas
  • Education level: Academic Bachelor
  • Area of Expertise: Project Management & Services
  • Closing date: Saturday, May 12, 2018
Apply now

Feel free to contact


Meline Silverio

Account manager Brunel Energy USA Houston


Related vacancies

    Job Alert

    Send me an email with the latest vacancies matching SDLC Developer - Texas

    Search query is invalid or corrupted You are already subscribed to this Job Alert (duplicate)
    Frequency is not correctly filled in
    Please enter a valid email address
    When creating a Job Alert you agree to our Privacy Statement. You can adjust or cancel your Job Alert at any time.

    Confirmation sent to