Senior Data Engineer
Visa•Bengaluru East, Karnataka, India
fulltime
Engineering
5+ years
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.
Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
Job Description
The Senior Data Engineer role involves building and delivering data assets and solutions, coordinating with other teams to manage and prioritize projects, and driving the strategy, roadmap, and execution of key data engineering initiatives. The role requires understanding and translating business needs into data solutions, creating robust data pipelines, and developing and maintaining data assets. It also involves implementing and maintaining CI/CD pipelines for data solutions. The candidate should be able to define and manage data load procedures, implement data strategies, and ensure robust operational data management systems. Collaborating with stakeholders across the organization to understand their data needs and deliver solutions is also a key part of this role. The ideal candidate will be proficient in big data tools and technologies including Hadoop, Hive, and Spark, Python, SQL, and have strong analytical skills related to working with structured and unstructured datasets.
This position is based in Visa's offices in Bangalore, India, and presents an excellent opportunity for those looking to make a significant impact in the field of Data Engineering.
Essential Functions:
This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager.
Qualifications
Preferred Qualifications;
4+ years of work experience with a bachelor’s degree or at least 3+ years of work experience with an Advanced degree (e.g. Master’s, MBA)
Exposure to Financial Services/ Payments Industry
Proven experience of working in a team of senior data engineers.
Extensive experience in big data tools: Hadoop, Hive, and Spark.
Proficiency in Python, SQL, and PySpark.
Experience with Unix/Linux systems with scripting experience in Bash.
Experience with data pipeline and workflow management tools like Airflow, etc .
Experience with relational SQL and NoSQL databases
Experience with cloud and platform services like Databricks, AWS or Azure.
Experience with stream-processing systems: Kafka, Spark-Streaming, etc.
Strong analytic skills related to working with structured & unstructured datasets.
Proficiency in managing and communicating data warehouse plans to internal clients.
Experience with building processes supporting data transformation, data structures, metadata, dependency, and workload management.
A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
Exposure in leveraging GenAI tools and platforms for enabling efficiency.
Other Skills:
Strong problem-solving skills.
Excellent communication skills.
Ability to work in a team.
Detail-oriented and excellent organizational skills.
Additional Information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.