(USA) Senior Manager, Automation Engineering - Data Engineer
Job title: (USA) Senior Manager, Automation Engineering - Data Engineer in Bentonville, AR at Walmart
Company: Walmart
Job description: Position Summary... As the sole Data Engineer for Walmart Energy, you will collaborate with data scientists, analysts, and business leaders to design and implement scalable data solutions. You'll address complex problems, build real-time data pipelines, and support AI/ML analytics, ensuring robust data infrastructure for business intelligence and AI applications.This is an exciting opportunity to own the data engineering function within the Walmart Energy business team and help shape the future of data-driven decision-making in a high-impact environment. This role is based in Bentonville, Arkansas; no remote applicants are being considered at this time (full relocation package available.)About the Team
At Walmart, our mission to help people save money and live better drives our retail transformation. Walmart Energy leverages data to enhance sustainability, efficiency, and cost reduction. Join us to directly reduce emissions and support Walmart's 2040 emissions goals, making a tangible impact on sustainability at one of the world's largest companies.What you'll do...
- Collaborate on Data-Driven Solutions: Work with the Walmart Energy team and business stakeholders to design and implement data-driven solutions that enhance operational and strategic value.
- Develop Scalable Data Architectures: Build and maintain scalable data pipelines and architectures using Apache Airflow, Google Cloud Platform (GCP), and BigQuery, while ensuring optimal performance for data storage and analysis.
- Optimize BigQuery Structures: Design, create, and maintain BigQuery tables and schemas to support effective data storage, retrieval, and analysis needs, ensuring optimal performance.
- Leverage Real-Time Data Frameworks: Utilize frameworks such as Apache Kafka, Spark, or Flink to support streaming analytics and event-driven architectures.
- Automate Cloud Infrastructure: Implement Infrastructure as Code (IaC) practices with tools like Terraform or Kubernetes to automate and scale cloud-based data infrastructure.
- Create Data Visualizations and Support AI/ML Initiatives: Use visualization tools like Google Looker Studio, Power BI, and Tableau to develop dashboards for business decisions, and support AI/ML projects through feature engineering and data preparation. Stay informed on emerging technologies and industry trends to apply them to Walmart's energy initiatives.
- Proficiency in Python and SQL: Skilled in data manipulation and analysis with libraries like Pandas and NumPy.
- Expertise in Data Engineering and Cloud Platforms: Experienced with frameworks such as Apache Airflow, Kafka, Spark, and cloud platforms like GCP, BigQuery, Snowflake, or Redshift.
- Infrastructure as Code (IaC) and Scalability: Knowledgeable in IaC principles, using Terraform or Kubernetes, and able to design scalable data architectures for real-time and batch processing.
- Analytical and Collaborative Skills: Strong problem-solving abilities, capable of independent work, and effective collaboration with data scientists and analysts to develop data-driven solutions.
- Communication and Data Visualization: Proficient in creating visualizations with Google Looker Studio, Power BI, or Tableau, and experienced in AI/ML data engineering, including vector databases and ML feature stores.
- Multiple health plan options, including vision & dental plans for you & dependents
- Financial benefits including 401(k), stock purchase plans, life insurance and more
- Associate discounts in-store and online
- Education assistance for Associate and dependents
- Parental Leave
- Pay during military service
- Paid Time off - to include vacation, sick, parental
- Short-term and long-term disability for when you can't work because of injury, illness, or childbirth