AI / Databricks Consultant

Job Title: Senior AI / Databricks Consultant

Location: Houston, TX 77079

Duration: Long-Term Contract

Work Authorization: US Citizen, Green Card, or Authorized to Work in the US

Job Summary

We are seeking a highly experienced Senior AI Engineer with strong Databricks expertise to lead the design, architecture, and implementation of scalable AI and data solutions. This role goes beyond development and requires ownership of end-to-end solution architecture within the Databricks Lakehouse ecosystem, ensuring high performance, scalability, and enterprise readiness.

Key Responsibilities

• Design and architect end-to-end AI/ML solutions on the Databricks Lakehouse Platform .
• Develop and optimize scalable data pipelines using Apache Spark and Databricks .
• Define and implement data architecture standards , including Delta Lake and Unity Catalog.
• Build and manage end-to-end ML pipelines (data ingestion, training, deployment, monitoring).
• Establish and implement MLOps frameworks using MLflow and CI/CD pipelines.
• Collaborate with business stakeholders to translate requirements into scalable AI solutions.
• Lead technical design discussions and provide architectural guidance across teams.
• Ensure performance optimization, cost efficiency, and reliability of Databricks workloads.
• Design batch and real-time processing systems (streaming, event-driven architectures).
• Integrate advanced AI capabilities such as LLMs and Generative AI into enterprise solutions.
• Enforce data governance, security, and compliance best practices.
• Mentor junior developers and contribute to team capability building.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field.
• 7+ years of experience in AI/ML, data engineering, or distributed systems.
• 3+ years of hands-on experience with Databricks .
• Strong expertise in Apache Spark (PySpark/Scala) .
• Advanced programming skills in Python (Scala is a plus).
• Proven experience in solution design and architecture .
• Deep understanding of data lakehouse architecture, ETL/ELT pipelines, and data modeling .
• Experience with ML lifecycle management (MLflow, deployment, monitoring) .
• Experience with cloud platforms ( Azure, AWS, or GCP ).

About INSPYR Solutions

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions’ Privacy Policy and INSPYR Solutions’ AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.