Building Validation Plans
12
Advanced and Custom Validation
Pointblank
: The Complete Guide to Data Validation in Python
Welcome
Foundations
1
Introduction
2
Getting Started
3
Inspecting & Profiling Your Data
4
The Validation Workflow
5
Validation in the Analysis Loop
Building Validation Plans
6
Column Value Validations
7
Aggregate Validations
8
Row and Completeness Validations
9
Table Structure and Freshness
10
Missing Data and Coded Missingness
11
Segmented Validation
12
Advanced and Custom Validation
Responding to Results
13
Thresholds and Actions
14
Reports and Extracts
15
Data Quality Scoring
16
Notifications and Observability
AI-Assisted Validation
17
Semantic Validation with LLMs
18
AI-Assisted Authoring
Data Sources, Interfaces & Automation
19
Working with Data Sources
20
YAML-Based Workflows
21
The Command-Line Interface
22
The MCP Server
Data Contracts & Pipelines
23
Data Contracts
24
Validation Pipelines
Test Data Generation
25
Generating Synthetic and Test Data
Clinical & Regulated Data
26
Validating Clinical Trial Data (CDISC SDTM & ADaM)
27
CDISC Submission Conformance
Industry Playbooks
28
Playbook: Financial Services & Fintech
29
Playbook: E-commerce & Retail
30
Playbook: Data Engineering & Analytics Platforms
31
Playbook: Healthcare & Life Sciences
32
Playbook: Real-World Evidence
33
Playbook: Machine Learning & Feature Monitoring
34
Playbook: Manufacturing & IoT Sensors
35
Playbook: Insurance & Actuarial
36
Playbook: Public Sector & Official Statistics
37
Playbook: Marketing & Digital Analytics
Appendices
A
Appendix: Method & API Reference
Table of contents
12.1
Native expressions with
col_vals_expr
12.2
Multi-condition rules with
conjointly
12.3
Arbitrary logic with
specially
12.4
Preprocessing with
pre
12.5
Referential integrity
12.6
Summary
Building Validation Plans
12
Advanced and Custom Validation
12
Advanced and Custom Validation
12.1
Native expressions with
col_vals_expr
12.2
Multi-condition rules with
conjointly
12.3
Arbitrary logic with
specially
12.4
Preprocessing with
pre
12.5
Referential integrity
12.6
Summary
11
Segmented Validation
13
Thresholds and Actions