Big Data Engineer

Heredia, Heredia, CR

Full Time
IBM logo
Apply now Apply later

Posted 3 weeks ago

At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Your Role and Responsibilities
BM Global Technology Services (GTS) is the IT infrastructure and business process services segment of IBM, one of the largest IT and software companies in the world.
GTS Analytics team in IBM is building a new innovative AIOPS solution by combining big data with Machine Learning and Deep Learning. AIOPS refers to multi-layered technology platforms that automate and enhance IT operations by using analytics and machine learning to analyze big data collected from various IT operations tools and devices, in order to automatically spot and react to issues in real-time. AIOPS bridges three different IT disciplines—service management, performance management, and automation—to accomplish its goals of continuous insights and improvements.
Some of the Solutions we work involve the following
Real time anomaly detection solutions that proactively identify service impacting incidents and prevent system downtimes. This is done by leveraging an ensemble of Deep learning and LSTM models. Natural Language Processing for entity, topic clusters and relationship extraction Text Analytics in human generated tickets and correlation with event tickets for event noise reduction. ApplyNatural Language Classification and RNN algorithms to automatically route tickets. Log Analysis - Text mining, message clustering/templatization, Logs to metrics, anomaly detection, event annotation and sequencing. Learn Log Message Sequence for each mainframe batch job and Identify Anomalies during job runs using sequence mining techniques and provide early warning/alerts. Cloud Migration - Patterns-based discovery optimization: Identify potential business application boundaries using an algorithmic approach from Cloudscape data. Wave planner: Employ goal-based reasoning from AI planning capabilities for Server affinity, cost, time, black-out windows, etc. To power the above use cases, we have a Big Data system that can handle 2-3 TB of data daily and we manage a data lake that is 15 PB in size.

Required Technical and Professional Expertise
Strong in Scala / Java
Strong in Java EE/Spring Web/Spring Boot
Strong in JavaScript, HTML, CSS
Strong in React/Angular
ORM tools like Hibernate
First-hand experience with Postgres and Oracle
Familiarity with Gradle/Maven
Knowledge in GO language
Knowledge in Micro Services Architecture is a must
Knowledge with Application Servers like Jboss/Wildfly/Websphere Application Server
Knowledge with SVN, Git, GitHub
Strong Design and Architecture skills in Enterprise Applications
First-hand experience with testing frameworks like JUnit/Arquillian/Protractor etc
At least 3 years of exp in Single Page application development
At least 3 years of development expe in Unix/Linux/Solaris environment

Preferred Technical and Professional Expertise
Kubernetes or Docker
Application packaging and deployment aspects
Familiar with Akka toolkit
Continuous Integration and Continuous Development knowledge
Working experience with Python

About Business Unit
At Global Technology Services (GTS), we help our clients envision the future by offering end-to-end IT and technology support services, supported by an unmatched global delivery network.  It's a unique blend of bold new ideas and client-first thinking. If you can restlessly reinvent yourself and solve problems in new ways, work on both technology and business projects, and ask, "What else is possible?" GTS is the place for you!

Your Life @ IBM
What matters to you when you’re looking for your next career challenge?

Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible.

Impact. Inclusion. Infinite Experiences. Do your best work ever.

About IBM
IBM’s greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries.

Location Statement
For additional information about location requirements, please discuss with the recruiter following submission of your application.

Being You @ IBM
IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Job tags: AI Big Data Consulting Deep Learning Java JavaScript Kubernetes Linux Machine Learning Oracle Postgres Python RNN Scala