What Is Data Appending? How It Works and Where It Goes Wrong

Definition

Data appending is adding missing fields to records you already hold, such as an email address, phone number, postal address or industry code, by matching each record against an outside database on details like name and address. It fills gaps in a customer or prospect file so you can reach people through another channel or segment them.

The Merlin team7 min read

Data appending starts with a file you already own and a column that's mostly empty. Your CRM has names and street addresses for every customer but email addresses for only some of them, or a lead list has company names but no industry or headcount. An append sends those records to a provider with a much larger database, finds the same person or company there, and copies the missing values back into your file as new columns.

The word is literal: data is added to the end of a record rather than replacing what's there. Whether you can then use what comes back is a separate question, answered by privacy law further down.

How a data append works

A data append matches each of your records to one in a reference database, using a few fields both sides share, then returns the fields you asked for:

  1. Clean the file first. Remove duplicates and dead records, and put names, addresses and company names in one consistent format.
  2. Pick the match keys. These are the fields the provider compares: for people, usually name plus postal address, or an email or phone number; for businesses, company name, website domain or address.
  3. Choose the fields to add. Ask only for columns you have a use for, such as an email for a campaign or an industry code for routing leads.
  4. Run the match. The provider compares your records with its own and returns the file with the new columns filled where it found a match, and blank where it didn't.
  5. Check before you load. Look at how many records matched, spot-check a sample against what you know, and keep the source and date of each appended field.

Appends run in two ways, as Clay's glossary entry notes: as a batch, where you upload a file and get it back, or in real time through an API, where a field is filled the moment a record is created, for example name and address appearing as a phone number is typed into a form.

The main types of data append

Data appends are named after what you send and what you get back. A "reverse" append runs the usual direction backwards, starting from a contact detail and returning the person behind it.

Common kinds of data append

Type

You send

You get back

Email append

Name and postal address

An email address for that person

Phone append

Name and postal address

A phone number

Reverse phone append

A phone number

Name and postal address, sometimes more

Address update

Name and old postal address

The new address of someone who has moved

Firmographic append

Company name, domain or address

Industry codes such as NAICS or SIC, and other company facts

Demographic append

Name and address

Age, marital status, interests and similar consumer attributes

Employer append

Name and address

Where the person works

Some of these lean on official data. In the US, address updates for people who have moved come from the Postal Service's NCOALink change-of-address data, which only licensed and certified providers can process; full-service providers get 48 months of moves and limited-service providers 18. Firmographic appends often add industry classification codes, and the NAICS Association sells NAICS and SIC code appends for business files. Employer appends are common in fundraising: Double the Donation's guide explains that knowing where a donor works shows which matching-gift and volunteer-grant programs they may qualify for.

An example worked through

Say your company has 8,000 customer records from in-store purchases. Every record has a name and a postal address, but only 5,000 have an email address, because the field was optional at the register. You want to announce a spring sale by email as well as by mail.

You send the 3,000 records without emails for an email append, keyed on name and postal address. Suppose the provider matches 1,100 of them. Your file now has 6,100 email addresses, and the other 1,900 records stay blank. Before anything goes out, check how confident each match is (a common name at an apartment building is easy to get wrong), and whether you may email people who never gave you that address, which depends on the country.

Data appending vs. data enrichment

Data appending fills specific blank fields by matching records to an outside source; data enrichment is usually the broader practice of adding anything that helps you understand a record, including signals a provider infers rather than looks up. The two are used loosely, even by the same company: Clay's appending entry treats them as different in scope, while its enrichment entry says enrichment is "also known as data appending."

A useful working line: if you can name the empty column before you start (email, phone, NAICS code), you're appending. If you're adding layers for scoring or research, such as the software a company uses, hiring activity or a buying-intent score, that's enrichment. Data cleansing gets mixed in too, though it corrects or removes what's already in a record rather than adding to it. An address update sits between appending and cleansing, because it replaces an old value with a newer one from an outside source.

Appending matters most when a sales or marketing team works from a defined list. An account-based marketing program, for example, often needs firmographic fields on every target company before the accounts can be ranked.

The privacy rules that apply

An appended email address or phone number is personal data the person didn't give you, and which rules apply depends on where the people in your file are.

United States: CAN-SPAM

The CAN-SPAM Act doesn't require consent before sending commercial email, but every message has to meet its rules. The FTC's compliance guide lists them: accurate header and sender information, an honest subject line, a clear statement that the message is an ad, a valid physical postal address, and a working opt-out that you honor within 10 business days. The same guide lists harvesting email addresses or generating them through a dictionary attack (combining names, letters or numbers into possible addresses) among the aggravated violations. Phone and text outreach falls under separate telemarketing rules, so check those before calling or texting appended numbers.

EU and UK: GDPR

Under the GDPR, appended data counts as personal data obtained from another source, which brings a duty to tell people. The European Commission's guidance for businesses says the information must reach them within one month of obtaining the data at the latest, or sooner if you first contact them or pass the data on, and must include where the data came from. The UK regulator's guidance on the right to be informed sets out the same timing.

The UK Information Commissioner's Office goes further on appending for marketing. Its direct marketing guidance says that getting contact details people haven't agreed to share, which it calls data matching or appending, is likely to be unfair in most cases, because people must be able to choose which contact details they give you.

Common mistakes

  • Appending onto a messy file. Duplicates and misspelled names produce wrong matches, and a wrong match looks exactly like a right one in the returned file.
  • Overwriting what customers told you. An appended value should sit beside the one the customer gave you, not replace it. The customer's own answer is usually the better one.
  • Treating an appended address as an opt-in. A matched email address is a way to reach someone, not permission to market to them.
  • Losing the paper trail. If you don't record the source and date of each appended field, you can't answer a person who asks where you got their details, and you can't tell old data from new.

Frequently asked questions

What is a data append service?

It's a provider that takes your file, matches each record to its own larger database, and returns the file with missing fields such as email, phone, address or company data filled in. Providers work in batches from an uploaded file, in real time through an API, or both.

What is a reverse append?

A reverse append starts from a contact detail, such as an email address or phone number, and returns the name and postal address of the person it belongs to. A standard append goes the other way.

Is data appending legal?

It depends on where the people in your file are. In the US, CAN-SPAM doesn't require consent before commercial email, but every message must follow its rules. In the EU and UK you generally must tell people within a month that you hold their data and where it came from, and the UK regulator considers appending contact details for marketing likely to be unfair in most cases.

Is data appending the same as data enrichment?

They overlap and are often used as synonyms. Appending usually means filling specific blank fields by matching records, while enrichment is broader and can include inferred data such as intent signals or scores.

Merlin is an assistant for your Mac that keeps track of the people you work with and what you promised them.Get Merlin

you scrolled all the way down here

your next free moment starts in three minutes

getting started takes three minutes. sign in, and i'm on your to-dos, starting with who's waiting on you

you decide what comes after

Download for Mac Free forever. No credit card.