Can't find what you're looking for?

Join our Talent Network
Join our Talent Network

Senior Software Engineer-Data Engineering

This job posting is no longer active.

Location: Bangalore, KA, India
Date Posted: Aug 31, 2020

Share: mail

Job Description



Come join a world class organization and play a key role in its digital transformation. Caterpillar is looking for talented and motivated software engineers to build a world class platform to host a wide range of applications.


Sr. Software Engineer contributes to design, development and deployment of Caterpillar’s state-of-the-art digital platform and will have responsibility for working on a variety of data projects. This includes orchestrating pipelines using modern Data tools/architectures as well as designing and engineering of existing data processing systems. This position contributes to design, development and deployment of Caterpillar’s state-of-the-art digital platform.  This position will build a world class platform to host a wide range of digital applications.  






JOB DUTIES: Responsibilities of the incumbents are across functional lines with individuals assigned in new program development and/or maintenance of existing mobile, WEB, Cloud, server, personal computer, mainframe, and/or distributed computing systems.

  1. Creates robust and automated pipelines to ingest and process structured and unstructured data from source systems into analytical/non-analytical platforms using batch and streaming mechanisms leveraging cloud native toolset

  2. Guide the team to develop a structured application/interface code, new program documentation, operations documentation and user guides in a casual, flexible environment

  3. Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness

  4. Drives application development focused around delivering business valuable features

  5. Mentor and assist developers, providing technical assistance and direction as needed

  6. Maintains high standards of software quality within the team by establishing good practices and habits

  7. Lead development of new functionality and applications on cross-functional Agile project teams

  8. Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.

  9. Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

  10. Implement custom applications using tools such as Kinesis, Lambda and other AWS tools as required to address streaming use cases

  11. Engineers and supports data structures including but not limited to SQL and NoSQL databases

  12. Engineers and maintain ELT processes for loading Snowflake and AWS data

  13. Engineers API’s for returning data from these structures to the Enterprise/Customer Applications

  14. Leverages the right tools for the right job to deliver testable, maintainable, and modern data solutions

  15. Works with other scrum team members to estimate and deliver work inside of a sprint

  16. Researches data questions, identifies root causes, and interacts closely with business users and technical resources

  17. Performance tunes queries and stored procedures to keep databases and applications optimized

  18. Reduces OT technical debt over time with root cause identification and resolution of system problems


    The position manages the completion of its own work assignments and coordinates work with others.  Based on past experiences and knowledge, the incumbent normally works independently with minimal management input and review of end results.


    Typical customers include Caterpillar customers, dealers, other external companies who purchase services offered by Caterpillar as well as internal business unit and/or service center groups.  The position is challenged to quickly and correctly identify problems that may not be obvious. The incumbent solves problems by determining the best course of action, within departmental guidelines, from many existing solutions. The incumbent sets priorities and establishes a work plan in order to complete broadly defined assignments and achieve desired results. The position participates in brainstorming sessions focused on developing new approaches to meeting quality goals in the measure(s) stated.



Basic qualifications:

  • Position requires a four-year degree from an accredited college or university.

  • Five years or more of data engineering experience or at least three years of experience with master’s degree in computer science or related field.

  • Five years or more of experience in designing and developing software applications in Java or at least three years of experience in Java with master’s degree in computer science or related field.

Top candidates will also have:

Proven/Strong understanding and/or experience in many of the following,

  • Experience designing data transformation pipelines. 
  • Able to create modern data pipelines and data processing using AWS PAAS components (Glue, etc.) or open source tools (Spark, Hbase, Hive, etc.).
  • Ability to develop SQL structures that support high volumes and scalability using RDBMS such as SQL Server, MySQL, Aurora, etc.
  • Ability to model and design modern data structures, SQL/NoSQL databases, Data Lakes, Cloud Data Warehouse (SnowFlake preferred)
  • Experience on Datastores such as DynamoDB, Redis, Elasticsearch, MySQL, Oracle, AWS RDS
  • Experience with Message brokers such as Kinesis, Kafka, Rabbitmq, AWS SQS, AWS SNS, Apache ActiveMQ.
  • Deploying software using CI/CD tools such as Azure Devops, Jenkins, etc.
  • Experience with API tools such as REST, Swagger, Postman and Assertible
  • Debugging and maintaining software in Linux or Unix platforms. 
  • Test driven development
  • Hands on experience with testing tools such as Selenium and Cucumber and their integration into CI/CD pipelines.
  • Experience building transactional databases.
  • Python, Java, Scala programming experience preferred
  • Prefer experience engineering solutions in AWS
  • AWS certification preferred but not required prior to hiring
  • Working in Agile Framework/Kanban Framework

  • Must demonstrate solid knowledge of computer science fundamentals like data structures & algorithms.

  • Passion for technology and an eagerness to contribute to a team-oriented environment.

  • Demonstrated leadership on medium to large-scale projects impacting strategic priorities.

  • Bachelor’s degree in Computer science or Electrical engineering or related field is required

Share: mail

Job Info

Aug 31, 2020