org.apache.beam.sdk.options.Validation Java Examples
The following examples show how to use
org.apache.beam.sdk.options.Validation.
You can vote up the ones you like or vote down the ones you don't like,
and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source File: PubsubToPubsub.java From DataflowTemplates with Apache License 2.0 | 5 votes |
@Description( "Filter attribute value to use in case a filterKey is provided. Accepts a valid Java regex" + " string as a filterValue. In case a regex is provided, the complete expression" + " should match in order for the message to be filtered. Partial matches (e.g." + " substring) will not be filtered. A null filterValue is used by default.") @Validation.Required ValueProvider<String> getFilterValue();
Example #2
Source File: DataflowPipelineOptions.java From beam with Apache License 2.0 | 5 votes |
@Description( "Project id. Required when running a Dataflow in the cloud. " + "See https://cloud.google.com/storage/docs/projects for further details.") @Override @Validation.Required @Default.InstanceFactory(DefaultProjectFactory.class) String getProject();
Example #3
Source File: BigQueryIOStorageReadTableRowIT.java From beam with Apache License 2.0 | 4 votes |
@Description("The table to be read") @Validation.Required String getInputTable();
Example #4
Source File: CassandraIOIT.java From beam with Apache License 2.0 | 4 votes |
@Description("Host for Cassandra server (host name/ip address)") @Validation.Required List<String> getCassandraHost();
Example #5
Source File: PostgresIOTestPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Database name for postgres server") @Validation.Required String getPostgresDatabaseName();
Example #6
Source File: KafkaIOIT.java From beam with Apache License 2.0 | 4 votes |
@Description("Options for synthetic source.") @Validation.Required String getSourceOptions();
Example #7
Source File: KafkaIOIT.java From beam with Apache License 2.0 | 4 votes |
@Description("Kafka topic") @Validation.Required String getKafkaTopic();
Example #8
Source File: SnowflakePipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("OAuth token. Required for OAuth authentication only.") @Validation.Required(groups = AUTH_VALIDATION_GROUP) String getOauthToken();
Example #9
Source File: SnowflakePipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Username. Required for username/password and Private Key authentication.") @Validation.Required(groups = AUTH_VALIDATION_GROUP) String getUsername();
Example #10
Source File: SnowflakePipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Server Name - full server name with account, zone and domain.") @Validation.Required(groups = BASIC_CONNECTION_INFO_VALIDATION_GROUP) String getServerName();
Example #11
Source File: SnowflakePipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description( "Snowflake's JDBC-like url including account name and region without any parameters.") @Validation.Required(groups = BASIC_CONNECTION_INFO_VALIDATION_GROUP) String getUrl();
Example #12
Source File: PostgresIOTestPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Server name for postgres server (host name/ip address)") @Validation.Required String getPostgresServerName();
Example #13
Source File: BigQueryIOStorageReadIT.java From beam with Apache License 2.0 | 4 votes |
@Description("The expected number of records") @Validation.Required long getNumRecords();
Example #14
Source File: BigQueryIOStorageReadIT.java From beam with Apache License 2.0 | 4 votes |
@Description("The table to be read") @Validation.Required String getInputTable();
Example #15
Source File: BigQueryIOReadIT.java From beam with Apache License 2.0 | 4 votes |
@Description("The expected number of records") @Validation.Required long getNumRecords();
Example #16
Source File: BigQueryIOReadIT.java From beam with Apache License 2.0 | 4 votes |
@Description("The table to be read") @Validation.Required String getInputTable();
Example #17
Source File: BigQueryIOStorageQueryIT.java From beam with Apache License 2.0 | 4 votes |
@Description("The table to be queried") @Validation.Required String getInputTable();
Example #18
Source File: CoGroupByKeyLoadTest.java From beam with Apache License 2.0 | 4 votes |
@Description("Options for synthetic co-source.") @Validation.Required String getCoSourceOptions();
Example #19
Source File: LoadTestOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Options for synthetic source") @Validation.Required String getSourceOptions();
Example #20
Source File: SyntheticDataPublisher.java From beam with Apache License 2.0 | 4 votes |
@Description("Options for synthetic source") @Validation.Required String getSourceOptions();
Example #21
Source File: KafkaCSVTableIT.java From beam with Apache License 2.0 | 4 votes |
@Description("Kafka topic") @Validation.Required @Default.String("test") String getKafkaTopic();
Example #22
Source File: KafkaCSVTableIT.java From beam with Apache License 2.0 | 4 votes |
@Description("Kafka server address") @Validation.Required @Default.String("localhost:9092") String getKafkaBootstrapServerAddress();
Example #23
Source File: DataCatalogPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
/** Whether to truncate timestamps in tables described by Data Catalog. */ @Description("Truncate sub-millisecond precision timestamps in tables described by Data Catalog") @Validation.Required @Default.Boolean(false) boolean getTruncateTimestamps();
Example #24
Source File: DataCatalogPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
/** DataCatalog endpoint. */ @Description("Data catalog endpoint.") @Validation.Required @Default.String("datacatalog.googleapis.com:443") String getDataCatalogEndpoint();
Example #25
Source File: BeamSqlDataCatalogExample.java From beam with Apache License 2.0 | 4 votes |
/** Output file prefix. */ @Description("Required. Output file prefix.") @Validation.Required String getOutputFilePrefix();
Example #26
Source File: BeamSqlDataCatalogExample.java From beam with Apache License 2.0 | 4 votes |
/** SQL Query. */ @Description("Required. SQL Query containing the pipeline logic.") @Validation.Required String getQueryString();
Example #27
Source File: BigQueryTornadoes.java From beam with Apache License 2.0 | 4 votes |
@Description( "BigQuery table to write to, specified as " + "<project_id>:<dataset_id>.<table_id>. The dataset must already exist.") @Validation.Required String getOutput();
Example #28
Source File: MaxPerKeyExamples.java From beam with Apache License 2.0 | 4 votes |
@Description("Table to write to, specified as " + "<project_id>:<dataset_id>.<table_id>") @Validation.Required String getOutput();
Example #29
Source File: JoinExamples.java From beam with Apache License 2.0 | 4 votes |
@Description("Path of the file to write to") @Validation.Required String getOutput();
Example #30
Source File: CombinePerKeyExamples.java From beam with Apache License 2.0 | 4 votes |
@Description( "Table to write to, specified as " + "<project_id>:<dataset_id>.<table_id>. " + "The dataset_id must already exist") @Validation.Required String getOutput();