org.apache.beam.sdk.options.Validation Java Examples

The following examples show how to use org.apache.beam.sdk.options.Validation. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source File: PubsubToPubsub.java    From DataflowTemplates with Apache License 2.0 5 votes vote down vote up
@Description(
    "Filter attribute value to use in case a filterKey is provided. Accepts a valid Java regex"
        + " string as a filterValue. In case a regex is provided, the complete expression"
        + " should match in order for the message to be filtered. Partial matches (e.g."
        + " substring) will not be filtered. A null filterValue is used by default.")
@Validation.Required
ValueProvider<String> getFilterValue();
 
Example #2
Source File: DataflowPipelineOptions.java    From beam with Apache License 2.0 5 votes vote down vote up
@Description(
    "Project id. Required when running a Dataflow in the cloud. "
        + "See https://cloud.google.com/storage/docs/projects for further details.")
@Override
@Validation.Required
@Default.InstanceFactory(DefaultProjectFactory.class)
String getProject();
 
Example #3
Source File: BigQueryIOStorageReadTableRowIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The table to be read")
@Validation.Required
String getInputTable();
 
Example #4
Source File: CassandraIOIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Host for Cassandra server (host name/ip address)")
@Validation.Required
List<String> getCassandraHost();
 
Example #5
Source File: PostgresIOTestPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Database name for postgres server")
@Validation.Required
String getPostgresDatabaseName();
 
Example #6
Source File: KafkaIOIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Options for synthetic source.")
@Validation.Required
String getSourceOptions();
 
Example #7
Source File: KafkaIOIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Kafka topic")
@Validation.Required
String getKafkaTopic();
 
Example #8
Source File: SnowflakePipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("OAuth token. Required for OAuth authentication only.")
@Validation.Required(groups = AUTH_VALIDATION_GROUP)
String getOauthToken();
 
Example #9
Source File: SnowflakePipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Username. Required for username/password and Private Key authentication.")
@Validation.Required(groups = AUTH_VALIDATION_GROUP)
String getUsername();
 
Example #10
Source File: SnowflakePipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Server Name - full server name with account, zone and domain.")
@Validation.Required(groups = BASIC_CONNECTION_INFO_VALIDATION_GROUP)
String getServerName();
 
Example #11
Source File: SnowflakePipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "Snowflake's JDBC-like url including account name and region without any parameters.")
@Validation.Required(groups = BASIC_CONNECTION_INFO_VALIDATION_GROUP)
String getUrl();
 
Example #12
Source File: PostgresIOTestPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Server name for postgres server (host name/ip address)")
@Validation.Required
String getPostgresServerName();
 
Example #13
Source File: BigQueryIOStorageReadIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The expected number of records")
@Validation.Required
long getNumRecords();
 
Example #14
Source File: BigQueryIOStorageReadIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The table to be read")
@Validation.Required
String getInputTable();
 
Example #15
Source File: BigQueryIOReadIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The expected number of records")
@Validation.Required
long getNumRecords();
 
Example #16
Source File: BigQueryIOReadIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The table to be read")
@Validation.Required
String getInputTable();
 
Example #17
Source File: BigQueryIOStorageQueryIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The table to be queried")
@Validation.Required
String getInputTable();
 
Example #18
Source File: CoGroupByKeyLoadTest.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Options for synthetic co-source.")
@Validation.Required
String getCoSourceOptions();
 
Example #19
Source File: LoadTestOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Options for synthetic source")
@Validation.Required
String getSourceOptions();
 
Example #20
Source File: SyntheticDataPublisher.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Options for synthetic source")
@Validation.Required
String getSourceOptions();
 
Example #21
Source File: KafkaCSVTableIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Kafka topic")
@Validation.Required
@Default.String("test")
String getKafkaTopic();
 
Example #22
Source File: KafkaCSVTableIT.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Kafka server address")
@Validation.Required
@Default.String("localhost:9092")
String getKafkaBootstrapServerAddress();
 
Example #23
Source File: DataCatalogPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
/** Whether to truncate timestamps in tables described by Data Catalog. */
@Description("Truncate sub-millisecond precision timestamps in tables described by Data Catalog")
@Validation.Required
@Default.Boolean(false)
boolean getTruncateTimestamps();
 
Example #24
Source File: DataCatalogPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
/** DataCatalog endpoint. */
@Description("Data catalog endpoint.")
@Validation.Required
@Default.String("datacatalog.googleapis.com:443")
String getDataCatalogEndpoint();
 
Example #25
Source File: BeamSqlDataCatalogExample.java    From beam with Apache License 2.0 4 votes vote down vote up
/** Output file prefix. */
@Description("Required. Output file prefix.")
@Validation.Required
String getOutputFilePrefix();
 
Example #26
Source File: BeamSqlDataCatalogExample.java    From beam with Apache License 2.0 4 votes vote down vote up
/** SQL Query. */
@Description("Required. SQL Query containing the pipeline logic.")
@Validation.Required
String getQueryString();
 
Example #27
Source File: BigQueryTornadoes.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "BigQuery table to write to, specified as "
        + "<project_id>:<dataset_id>.<table_id>. The dataset must already exist.")
@Validation.Required
String getOutput();
 
Example #28
Source File: MaxPerKeyExamples.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Table to write to, specified as " + "<project_id>:<dataset_id>.<table_id>")
@Validation.Required
String getOutput();
 
Example #29
Source File: JoinExamples.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Path of the file to write to")
@Validation.Required
String getOutput();
 
Example #30
Source File: CombinePerKeyExamples.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "Table to write to, specified as "
        + "<project_id>:<dataset_id>.<table_id>. "
        + "The dataset_id must already exist")
@Validation.Required
String getOutput();