Documentation

Content Filters & Duplicate Detection

How the filter engine screens incoming items, how to configure blocked keywords, and how duplicate detection keeps your site clean.

Filter Rules

The filter engine evaluates each fetched item before it is published. Items that match a rule can be rejected (discarded entirely) or saved as draft (held for manual review). There is no separate “flag” status — draft is the holding state. Publish (allow through) is also available as an action option per rule.

Pro tier enables a core 6-rule set. Business tier unlocks all 14 rules. Each rule has an Enable toggle and a configurable Action: Reject (item is discarded), Draft (item is saved as a draft for manual review), or Publish (allow through).

RuleWhat it checksTier
No titleItem has an empty or missing titlePro+
No contentItem has an empty or missing body / descriptionPro+
No source URLItem has no source/link fieldPro+
Invalid URL formatSource URL is malformed or unreachablePro+
Duplicate titleA post with this exact title already existsPro+
Duplicate URLA post with this source URL already existsPro+
Short titleTitle is below the configured minimum lengthBusiness
Short contentContent is below the configured minimum lengthBusiness
Long contentContent exceeds the configured maximum lengthBusiness
No imageItem has no image URL / no featured imageBusiness
Broken imageImage URL returns a non-200 HTTP response or non-image contentBusiness
No dateItem has no publication date fieldBusiness
No descriptionItem has no excerpt/description fieldBusiness
Blocked keywordsAny field contains a word from the blocked listBusiness

Rules are evaluated independently. Rule priority order is: reject > draft > publish. The most restrictive action among all triggered rules wins — if any reject rule fires, the item is always discarded regardless of other rules.

To configure filters: go to Ingestics → Filters, enable and set the action for each rule, configure numeric limits for Business threshold rules (minimum title length in characters, minimum content length, long content threshold, broken image cache TTL), then click Save Filters. Filters apply to every item on the next fetch.

Blocked Keywords Business

Maintain a global list of blocked keywords. Any item where any field contains a blocked keyword is automatically rejected before publishing — regardless of other filter rules.

  1. Go to Ingestics → Settings → Blocked Keywords.
  2. Add one keyword or phrase per line (comma-separated keywords in the Filters tab). Any item with these words in the title or content triggers the configured action.
  3. Save. The list applies to all providers immediately.

Duplicate Detection

Ingestics checks each incoming item against existing WordPress posts before publishing. Duplicate detection uses the configured duplicate fields, with title and source URL as the default comparison path. If a duplicate is found, the item is skipped or handled according to the configured filter behavior. Duplicate detection is active on all tiers, is automatic, and requires no configuration.