Building Validation Plans
8
Row and Completeness Validations
Pointblank
: The Complete Guide to Data Validation in Python
Welcome
Foundations
1
Introduction
2
Getting Started
3
Inspecting & Profiling Your Data
4
The Validation Workflow
5
Validation in the Analysis Loop
Building Validation Plans
6
Column Value Validations
7
Aggregate Validations
8
Row and Completeness Validations
9
Table Structure and Freshness
10
Missing Data and Coded Missingness
11
Segmented Validation
12
Advanced and Custom Validation
Responding to Results
13
Thresholds and Actions
14
Reports and Extracts
15
Data Quality Scoring
16
Notifications and Observability
AI-Assisted Validation
17
Semantic Validation with LLMs
18
AI-Assisted Authoring
Data Sources, Interfaces & Automation
19
Working with Data Sources
20
YAML-Based Workflows
21
The Command-Line Interface
22
The MCP Server
Data Contracts & Pipelines
23
Data Contracts
24
Validation Pipelines
Test Data Generation
25
Generating Synthetic and Test Data
Clinical & Regulated Data
26
Validating Clinical Trial Data (CDISC SDTM & ADaM)
27
CDISC Submission Conformance
Industry Playbooks
28
Playbook: Financial Services & Fintech
29
Playbook: E-commerce & Retail
30
Playbook: Data Engineering & Analytics Platforms
31
Playbook: Healthcare & Life Sciences
32
Playbook: Real-World Evidence
33
Playbook: Machine Learning & Feature Monitoring
34
Playbook: Manufacturing & IoT Sensors
35
Playbook: Insurance & Actuarial
36
Playbook: Public Sector & Official Statistics
37
Playbook: Marketing & Digital Analytics
Appendices
A
Appendix: Method & API Reference
Table of contents
8.1
Row distinctness
8.2
Row completeness
8.3
Combining distinctness and completeness
8.4
Beyond distinctness and completeness
8.5
Summary
Building Validation Plans
8
Row and Completeness Validations
8
Row and Completeness Validations
8.1
Row distinctness
8.1.1
Checking whole-row uniqueness
8.1.2
Choosing the key
8.2
Row completeness
8.2.1
Completeness on required fields
8.3
Combining distinctness and completeness
8.4
Beyond distinctness and completeness
8.5
Summary
7
Aggregate Validations
9
Table Structure and Freshness