Loading...

Data validation in Python: a look into Pandera and Great Expectations

Data validation in Python: a look into Pandera and Great Expectations
Data validation is a vital step in any data-oriented workstream. This post investigates and compares two popular Python data validation packages - Pandera and Great Expectations

Published on:

Learn more
endjin.com
endjin.com

We help small teams achieve big things.

Share post:

Related posts

TypeDeclaration: An Abstraction for Understanding JSON Schema

The Corvus.Json.CodeGeneration library analyses JSON Schema and builds a TypeDeclaration tree that maps schema patterns to code patterns. The ...

15 hours ago

Optimising DAX: Practical Examples

The final post in the Optimising DAX series: the CALCULATE trap, variables and IF.EAGER, slicer costs, and a practical approach to isolating s...

1 day ago

Optimising DAX: Data Materialisation

Data materialisation is when the storage engine gives up on efficient processing and rebuilds the entire table. This post explains what trigge...

2 days ago

Building API Reference Documentation From Code, Part 2: Under the Hood

A deep dive into the cross-assembly linking, PDB-based source links, TFM scanning, enrichment merging, and search indexing that power our API ...

3 days ago

Building API Reference Documentation From Code, Part 1: The Pipeline

We generate about 8,800 API reference pages from 16 libraries across two engine versions, with source links, TFM availability badges, and hand...

4 days ago

Writing Effective Copilot Instructions for Complex Codebases

A flat copilot-instructions.md works for small projects. When your codebase hits 500k lines, 19 projects, and multiple code generators, you ne...

7 days ago

Optimising DAX: The Formula Engine and Storage Engine

When you execute a DAX query, two engines divide up the work. Understanding the split between the formula engine and the storage engine is key...

8 days ago

Your Cloud AI SLA Tells You Less Than You Think

Traditional cloud SLAs measure API uptime, not behavioural stability. This post talks about how silent AI model drift can quietly break your a...

9 days ago

Trying Out WSL Containers: Microsoft's Built-In Alternative to Docker Desktop

Microsoft's new WSL Containers (wslc) promises container management on Windows without Docker Desktop. I tried it with dev containers, Aspire,...

10 days ago

AsyncAPI Code Generation with Corvus: Custom Transports

Implement a custom IMessageTransport for brokers not covered by the built-in packages - PublishAsync, SubscribeAsync, RequestAsync, dead-lette...

11 days ago
Stay up to date with latest Microsoft Dynamics 365 and Power Platform news!
* Yes, I agree to the privacy policy