limit
Limit the number of failures that will be returned by a test query. We recommend using this config when working with large datasets and storing failures in the database.
- Specific test
- One-off test
- Generic test block
- Project level
Configure a specific instance of a generic (schema) test:
models/<filename>.yml
version: 2
models:
- name: large_table
columns:
- name: very_unreliable_column
tests:
- accepted_values:
values: ["a", "b", "c"]
config:
limit: 1000 # will only include the first 1000 failures
Configure a one-off (data) test:
tests/<filename>.sql
{{ config(limit = 1000) }}
select ...
Set the default for all instances of a generic (schema) test, by setting the config inside its test block (definition):
macros/<filename>.sql
{% test <testname>(model, column_name) %}
{{ config(limit = 500) }}
select ...
{% endtest %}
Set the default for all tests in a package or project:
dbt_project.yml
tests:
+limit: 1000 # all tests
<package_name>:
+limit: 50 # tests in <package_name>
0