Join our dynamic and high-impact Data team as a Data Engineer, where you'll be responsible for safely receiving and storing trading-related data for the India teams, as well as operating and improving our shared data access and data processing systems. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights. The ideal candidate should have work experience in systems engineering, preferably with prior exposure to financial markets and with proven working knowledge in the fields of Linux administration, orchestration and automation tools, systems hardware architecture as well as storage and data protection technologies.
Your Core Responsibilities
Manage and monitor all distributed systems, storage infrastructure, and data processing platforms, including HDFS, Kubernetes, Dremio, and in-house data pipelines
Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions
Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries
Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions
Your Skills And Experience
5–7 years of experience in managing large-scale multi-petabyte data infrastructure in a similar role
Advanced knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments
Deep expertise in at least one of the following technologies: Kafka, Spark, Cassandra/Scylla, or HDFS
Strong working knowledge of Docker, Kubernetes, and Helm
Experience with data access technologies such as Dremio and Presto
Familiarity with workflow orchestration tools like Airflow and Prefect
Exposure to cloud platforms such as AWS, GCP, or Azure
Proficiency with CI/CD pipelines and version control systems like Git
Understanding of best practices in data security and compliance
Demonstrated ability to solve problems proactively and creatively with a results-oriented mindset
Quick learner with excellent troubleshooting skills
High degree of flexibility and adaptability
About Us
IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.
ATS Match is available
1) Upload your resume. 2) Open any job and click Check ATS Match to see your fit score.