Data Platform Engineer

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent experience
• Experience supporting cloud-based data platforms in Azure, AWS, or both
• Hands-on experience coordinating Databricks environments in production
• Experience handling data lake platforms like ADLS Gen2 and Amazon S3
• Experience troubleshooting and supporting production data, analytics, or business intelligence platforms
• Experience developing scripts or automation using Python, Bash, or similar technologies
• Strong problem-solving skills and the ability to collaborate effectively across technical and business groups

Nice to Have

• Experience with Power BI and/or Tableau administration
• Experience with Apache Airflow, Kubernetes (AKS or EKS), or Apache Kafka
• Familiarity with MongoDB, Hive Metastore, MySQL, or vector databases
• Experience with monitoring and observability platforms such as Databricks System Tables, Splunk, or Prometheus
• Familiarity with Generative AI technologies, LangChain, LangSmith, vector search, or LLM-based tools
• Experience using Jira, ServiceNow, or similar operational support platforms

What You'll Be Doing

• Coordinate and support enterprise Databricks environments across Azure and AWS
• Handle cloud-based data storage systems like Azure Data Lake Storage (ADLS Gen2) and Amazon S3
• Support data integration and replication pipelines connecting enterprise platforms
• Provide operational support and mentorship for platform users
• Support analytics and visualization platforms including Power BI and Tableau
• Monitor platform health, performance, and usage while developing automation
• Partner with security teams to implement governance, compliance, and data protection controls
• Find opportunities to optimize cloud spending and improve resource utilization
• Evaluate and support emerging AI and Generative AI capabilities
• Collaborate with internal teams and external partners to troubleshoot issues and improve platform capabilities

Perks and Benefits

Information about perks and benefits is not specified in the provided job description.