Build Data Engineering Pipelines Using Snowpark in Snowflake Notebooks

Get started building data engineering pipelines using Snowpark in Snowflake Notebooks. In this session, you’ll learn how to build a pipeline with Python in Snowflake and then manage and deploy that notebook through an automated CI/CD. In this session, we’ll show you how to build: A data share from the Snowflake Marketplace to access weather data A data engineering pipeline with a Notebook to ingest Excel files into Snowflake A data engineering pipeline with a Notebook to transform and aggregate data A DAG (or Directed Acyclic Graph) of Tasks to orchestrate/schedule the pipelines A CI/CD pipeline to deploy the Notebooks to production