tailpipe collect

Run a collection.

Usage

Arguments

Flag	Description
--compact	Compact the Parquet files after collection (default true)
--from string	Collect days newer than a relative or absolute date.
--help	Help for collect

Global Flags

Flag	Description
--config-path	Sets the search path for configuration files. This argument accepts a colon-separated list of directories. All configuration files (*.tpc) will be loaded from each path, with decreasing precedence. The default is .:$TAILPIPE_INSTALL_DIR/config (.:~/.tailpipe/config). This allows you to manage your workspaces and connections centrally in the ~/.tailpipe/config directory, but override them in the working directory / mod location if desired.
--workspace	Sets the Tailpipe workspace profile. If not specified, the default workspace will be used if it exists. See workspace for details.

Flag

Description

--config-path

Sets the search path for configuration files. This argument accepts a colon-separated list of directories. All configuration files (*.tpc) will be loaded from each path, with decreasing precedence. The default is .:$TAILPIPE_INSTALL_DIR/config (.:~/.tailpipe/config). This allows you to manage your workspaces and connections centrally in the ~/.tailpipe/config directory, but override them in the working directory / mod location if desired.

--workspace

Sets the Tailpipe workspace profile. If not specified, the default workspace will be used if it exists. See workspace for details.

Examples

Collect everything.

Collect all partitions in the aws_cloudtrail_log table.

Collect one partition in the aws_cloudtrail_log table.

Collect all partitions in the aws_cloudtrail_log table for the last 45 days.

Collect all partitions in the aws_cloudtrail_log between January and June.

Collect all partitions in the aws_cloudtrail_log table and output JSON.