Remove Duplicates

Remove duplicate items from a list

What does this node do?

The Remove Duplicates node removes duplicate items from a list and returns only the unique values.

Common uses:

• Deduplicate keyword lists after merging multiple sources
• Clean merged data to ensure no repeated entries
• Ensure unique email addresses before sending campaigns

Quick setup

Configuration

This node has no custom parameters. Only the standard Name and Description fields are available.

Input

Output

A JSON array containing only the unique items from the input list, preserving the original order of first occurrence.

{
  "unique_list": ["apple", "banana", "cherry"]
}

Examples

Deduplicate keywords after merging

graph LR
    A[Semrush Keywords] --> C[Merge Lists]
    B[Google Search Console] --> C
    C --> D[Remove Duplicates]
    D --> E[LLM Analysis]

Combine keyword lists from multiple SEO tools, then remove duplicates before analysis to avoid counting the same keyword twice.

Clean email list before sending

graph LR
    A[Notion Database Reader] --> B[Remove Duplicates]
    B --> C[Loop]
    C --> D[Email Sender]

Ensure each email address appears only once before iterating through the list with a Loop node.

Common issues

Input is not recognized as a list

The list input must be a valid JSON array (e.g., ["a", "b", "c"]). If you pass a plain string or an object, the node may not process it correctly. Make sure the upstream node outputs a proper array.

Objects are not being deduplicated

For lists of objects, duplicates are determined by comparing the full object structure. Two objects with the same values but different key orders may or may not be considered duplicates. If you need to deduplicate objects by a specific property, use a Code Block node instead.

Related nodes