Secure Batch Data Transfer — Scheduled, Reliable, Auditable

Secure Batch Data Transfer

Batch data transfer — delivering a set of files on a schedule to a partner or internal system — is one of the most common operational patterns in enterprise file exchange.

Xferity is well suited for batch transfer: flows run on schedule, pick up all matching files, apply PGP encryption if needed, deliver to the partner, and leave an audit trail of exactly what was sent.

The batch transfer pattern

A typical batch transfer looks like:

a source system writes files to a staging directory
Xferity picks up the files at the scheduled time
files are optionally encrypted or compressed
Xferity uploads them to the partner endpoint
source files are deleted after confirmed delivery
audit records confirmation which files were sent and when

Xferity configuration for batch workflows

flows:
  daily-payroll-batch:
    direction: upload
    enabled: true
    target:
      partner: payroll-processor
      path: /incoming
    local:
      path: ./storage/payroll/outgoing
    files:
      - pattern: "*.csv"
    pgp:
      provider: gopenpgp
      encrypt: true
      public_key_path: file:./keys/payroll/processor-public.asc
    idempotency_mode: hash
    delete_after_upload: true
    delete_encrypted_after_upload: true
    schedule_cron: "0 0 5 * * 1-5"
    notifications:
      on_failure: true
      email_to: payroll-ops@example.com

Idempotency for batch transfers

When a batch job fails partway through, idempotency prevents re-sending files already delivered. The hash mode records which files were processed and skips them on retry.

Delivery confirmation

Use the audit trace to confirm what was in each batch:

xferity trace payroll-2026-03-15.csv

For a full batch run, review xferity flow history daily-payroll-batch.