Software Engineer (contract)

Title: Software Engineer

Location: Charlotte, NC

Duration: 12 months

Work Engagement: W2

Benefits on offer for this contract position : Health Insurance, Life insurance, 401K and Voluntary Benefits

Overview This role supports the Model Risk Management platform used to run statistical risk models and large-scale data workloads. The engineer will help maintain and enhance a cloud-native platform used by statisticians and data scientists working with millions of customer accounts. The platform runs on Google Cloud Platform and supports distributed data processing using Apache Spark.

Experience with large-scale datasets, GCP services, Spark, and containerized microservices is essential. Experience in financial services is preferred but not required.

Key Responsibilities Platform Engineering

Deploy, configure, and maintain OpenShift clusters or GCP projects for Spark workloads

Support platform capabilities for statistical model execution

Distributed Data Processing

Design and implement large-scale data processing workflows using Apache Spark

Tune Spark jobs using Kubernetes orchestration and auto-scaling

Application & Tooling

Build Python/Django services and microservices supporting platform users

Configure tooling and internal applications for data processing and model execution

Automation & CI/CD

Build and maintain CI/CD pipelines using GitHub Actions, Sonar, Harness, Helm

Monitoring & Troubleshooting

Monitor Spark jobs and cluster health using Prometheus, Grafana, and GCP tools

Debug distributed systems and optimize resource utilization

Security & Compliance

Implement RBAC and encryption for data in transit and at rest

Collaboration

Work closely with cross-functional teams to define requirements and support deployments

Qualifications

• Applicants must be authorized to work for ANY employer in the U.S. This position is not eligible for visa sponsorship.
• Strong experience working on Apache Spark for big data processing.
• Hands on Django development experience.
• Proficiency in creating and maintaining conda environments.
• Experience with managing containerized environments with OpenShift or Kubernetes
• Proficiency in Spark frameworks(Python/PySpark, Scala, or Java)
• Hands-on experience with OpenShift administration (e.g., cluster setup, networking, storage)
• Proficiency in creating and maintaining conda environments and dependencies
• Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images)
• Knowledge of distributed systems, cloud platforms(AWS, GCP, Azure), and data storage solutions (e.g., S3, HDFS)
• Programing: Strong coding skills in Python, Scala, or Java; experience with shell scripting is a plus.
• Tools: Experience with Git Actions, Helm, Harness, and CI/CD tools.
• Problem-Solving: Ability to debug complex issues across distributed systems and optimize resource usage.
• Education: Bachelor's degree in Computer Science, Engineering or related filed.

Education Bachelor’s degree in Computer Science, Engineering, or related field