Data Engineer - Sr. Consultant level

Visa
Austin, US
Hybrid

Why this role

Pace
Fast Paced
The role demands a fast-paced environment, as evidenced by the need to implement code in production within days and the emphasis on accelerated time-to-market delivery.
Collaboration
High
Collaboration is a key aspect of this role, as it involves working closely with product management and engineering teams to design and implement solutions, as well as participating in cross-functional and non-technical meetings.
Autonomy
High
The position offers significant autonomy, with the expectation that the candidate will take on leadership roles in multiple projects and drive internal proof of concept initiatives.
Decision Impact
Team
Decisions made in this role can have a substantial impact on the company's products and services, as the candidate is responsible for architecting highly secure, robust, and scalable solutions.
Role Level
Team Lead
The complexity of the role is high, given the need to handle large-scale data engineering, develop ETL processes, and maintain Spark pipelines, among other technical tasks.

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • design, enhance, and build Visa data token platform
  • drive innovation to differentiate products
Typical background
8+ years of relevant work experience in data engineering

Transferable backgrounds

  • Coming from Data Engineer at a financial services company
    data engineering · cloud services
    The experience in handling large-scale data engineering and working with cloud services will be directly applicable to the role at Visa.
  • Coming from Consultant at a tech consultancy firm
    agile development · team leadership
    The background in agile development methodologies and leading teams will be valuable in driving internal initiatives and managing projects.
  • Coming from Software Developer at a startup
    full-stack development · continuous integration
    Experience in full-stack development and implementing CI/CD processes will be highly relevant for building and maintaining scalable systems.

Skills & requirements

Required

Full-stack DevelopmentReal-time Scoring ServicesRestful ApisContainer-based Distributed ServicesMachine LearningDeep LearningContainerization Technologies (docker, Kubernetes)JavaSpring BootReactHadoopSparkScala

Preferred

Data WarehousingETL Processes

Stack & domain

JavaSpring BootReactHadoopSparkScalaDockerKubernetesRedisFlinkTensorFlowTritonAWSUnix/shellPythonAirflowControl-mReduxHtml5CSS4JqueryJavaScriptAgileTDDCI/CDRelational DatabasesNon-relational DatabasesLeadershipMentoringCollaborationAccountabilityPaymentsTechnology

About the role

This senior-level position requires a seasoned data engineer to lead the development of cutting-edge data solutions, integrating machine learning and deep learning technologies, and collaborating with cross-functional teams to drive innovation and improve product offerings.

Original posting from Visa via LinkedIn

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world.

Progress starts with you.

Job Description

As a Senior Consultant Data Engineer, you'll join our Value Added Services – Digital Marketing & Engagement organization. You'll help design, enhance, and build our Visa data token platform within an agile development environment. You'll collaborate with colleagues who will both support and challenge you daily.

You will take on leadership roles in multiple projects, building full-stack development of real-time scoring services, RESTful APIs, and container-based distributed services. These services are designed to be highly available, secure, scalable, and resilient.

You'll also spearhead the development of next-generation software, incorporating machine learning and deep learning technologies. We believe in self-managing Agile teams that build end-to-end products, emphasizing unit testing, code reviews, and continuous integration for excellent code quality. You'll witness the code you write move to production within just a few days.

This role involves driving innovation to differentiate our products from competitors and delight customers with accelerated time-to-market delivery. It demands proficiency in containerization technologies like Docker and Kubernetes, expertise in Java, Spring Boot, React, and both relational and non-relational databases. A strong background in data engineering with experience in Hadoop, Spark, and Scala is also essential for effective performance in this role.

If this sounds exciting, we'd love to chat with you further about our work culture, environment, and whether this would be a good fit for you

Essential Functions:

  • You’ll be the face of the team representing us in various technical forums.
  • You’ll help our customers achieve their business goals by understanding their requirements. You will build deep partnerships with product management to make sure that the products we are building deliver real value.
  • You’ll analyze business requirements and architect highly secure, robust, and scalable solutions.
  • You’ll drive internal proof of concept initiatives. When needed, quickly design and implement a prototype of a system or component with a proper architecture, and then lead or hand over to engineering team to implement.
  • You’ll champion efforts to architect, design and implement various components of our global transaction processing systems.
  • Your DNA will include following and creating software best practices and processes.
  • You’ll coach and mentor your team members and help them grow professionally. You will also create an atmosphere of mutual accountability.
  • You’ll play key role in meetings and discussions with cross-functional and non-technical teams.

This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:

8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD

Preferred Qualifications:

9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD

Demonstrated leadership in teams delivering high-quality, large-scale, enterprise-class applications.

Solid experience in big data engineering, with working knowledge of Hadoop, Apache Spark, Python, and SQL.

Deep experience in Java, with experience in REST APIs, container-based technologies, and implementing containerization strategies using Docker and Kubernetes.

Proficiency in creating and managing large-scale data pipelines, handling complex, high-volume, multi-dimensional data, and machine learning models.

Expertise in developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models.

Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, TensorFlow, Triton, AWS services, and containerized environments (Docker, K8s).

Skilled in Unix/Shell or Python scripting, using scheduling tools like Airflow and Control-M, and maintaining OPS tools.

Strong experience with UI technologies, including Redux, React.js, HTML5, CSS4, and jQuery/JavaScript standards.

Familiarity with Agile development incorporating TDD, CI/CD, and relational and non-relational databases.

Proven track record of building applications adhering to indus

Source: Visa careers (LinkedIn)

Similar roles