Get in Touch
 Duration 14 hours

Course Outline

Python Essentials for Data Operations

  • Python installation and development environment setup
  • Core language concepts: variables, data types, and control structures
  • Developing and executing basic Python scripts

File Management: CSV and Excel

  • Ingesting and exporting CSV files using the csv module and Pandas
  • Managing Excel files with openpyxl/xlrd and Pandas
  • Practical tasks: automating file format conversions

Foundations of Pandas

  • DataFrame essentials: creation, indexing, selection, and filtering
  • Aggregation and grouping techniques
  • Standard cleaning procedures: handling missing values, duplicates, and type casting

Introduction to Polars

  • Polars architecture and performance metrics compared to Pandas
  • Fundamental DataFrame operations within Polars
  • Application scenarios: determining when to prefer Polars over Pandas

Intermediate Data Transformation

  • Advanced joins, window functions, and pivot operations in Pandas
  • Optimized data processing patterns utilizing Polars
  • Chaining operations and memory usage optimization

Process Automation with Python

  • Scripting to automate repetitive data tasks and ETL steps
  • Scheduling scripts via OS or task schedulers
  • Implementing logging, error handling, and notification systems

Script Packaging and Best Practices

  • Generating executables with PyInstaller or equivalent tools
  • Project organization, virtual environments, and dependency management
  • Basics of version control and workflow documentation

Practical Mini-Project

  • End-to-end workflow: ingesting raw files, cleaning and transforming data, and generating outputs
  • Automating the workflow and packaging it as a runnable script or executable
  • Review and enhancement based on peer feedback

Recap and Future Directions

Requirements

  • Fundamental understanding of programming concepts or a strong inclination to learn
  • Confidence in using the command-line or terminal for package installation
  • Proficiency in working with spreadsheets (CSV/Excel)

Target Audience

  • Data analysts and operations personnel looking to automate data tasks
  • Analytical engineers seeking lightweight ETL scripting solutions
  • Professionals keen on implementing practical Python-based data workflows

Testimonials (2)

Related Categories