Java Code Examples for org.apache.beam.sdk.options.Default#Long
The following examples show how to use
org.apache.beam.sdk.options.Default#Long .
You can vote up the ones you like or vote down the ones you don't like,
and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source File: BigQueryOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("The maximum byte size of a single streaming insert to BigQuery.") @Default.Long(64L * 1024L) Long getMaxStreamingBatchSize();
Example 2
Source File: SamzaPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("The interval to check for watermarks in milliseconds.") @Default.Long(1000) long getWatermarkInterval();
Example 3
Source File: FlinkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("The maximum number of elements in a bundle.") @Default.Long(1000) Long getMaxBundleSize();
Example 4
Source File: FlinkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description( "The maximum time in milliseconds that a checkpoint may take before being discarded.") @Default.Long(-1L) Long getCheckpointTimeoutMillis();
Example 5
Source File: SamzaPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("The maximum time to wait before finalising a bundle (in milliseconds).") @Default.Long(1000) long getMaxBundleTimeMs();
Example 6
Source File: SparkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description( "If set bundleSize will be used for splitting BoundedSources, otherwise default to " + "splitting BoundedSources on Spark defaultParallelism. Most effective when used with " + "Spark dynamicAllocation.") @Default.Long(0) Long getBundleSize();
Example 7
Source File: SparkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description( "The period to checkpoint (in Millis). If not set, Spark will default " + "to Max(slideDuration, Seconds(10)). This PipelineOptions default (-1) will end-up " + "with the described Spark default.") @Default.Long(-1) Long getCheckpointDurationMillis();
Example 8
Source File: SparkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Max records per micro-batch. For streaming sources only.") @Default.Long(-1) Long getMaxRecordsPerBatch();
Example 9
Source File: FlinkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description( "Sets the delay in milliseconds between executions. A value of {@code -1} " + "indicates that the default value should be used.") @Default.Long(-1L) Long getExecutionRetryDelay();
Example 10
Source File: SparkPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("Batch interval for Spark streaming in milliseconds.") @Default.Long(500) Long getBatchIntervalMillis();
Example 11
Source File: LoadData.java From java-docs-samples with Apache License 2.0 | 4 votes |
@Description("The number of megabytes per row to write") @Default.Long(5) long getMegabytesPerRow();
Example 12
Source File: BigQueryOptions.java From beam with Apache License 2.0 | 4 votes |
@Description("The maximum number of rows to batch in a single streaming insert to BigQuery.") @Default.Long(500) Long getMaxStreamingRowsToBatch();
Example 13
Source File: TestPipelineOptions.java From beam with Apache License 2.0 | 4 votes |
@Default.Long(10 * 60) @Nullable Long getTestTimeoutSeconds();
Example 14
Source File: ReadData.java From java-docs-samples with Apache License 2.0 | 4 votes |
@Description("The number of megabytes per row written using the load data script.") @Default.Long(5) long getMegabytesPerRow();
Example 15
Source File: KeyReadsFn.java From dataflow-java with Apache License 2.0 | 4 votes |
@Description("Loci per writing shard") @Default.Long(10000) long getLociPerWritingShard();
Example 16
Source File: ElasticsearchTransforms.java From DataflowTemplates with Apache License 2.0 | 4 votes |
@Description("Batch size in number of documents. Default: 1000") @Default.Long(1000) Long getBatchSize();
Example 17
Source File: PubSubToMongoDB.java From DataflowTemplates with Apache License 2.0 | 4 votes |
@Description("Batch size in number of bytes. Default: 5242880 (5mb)") @Default.Long(5242880) Long getBatchSizeBytes();
Example 18
Source File: PubSubToMongoDB.java From DataflowTemplates with Apache License 2.0 | 4 votes |
@Description("Batch size in number of documents. Default: 1000") @Default.Long(1024) Long getBatchSize();
Example 19
Source File: ShardOptions.java From dataflow-java with Apache License 2.0 | 4 votes |
@Description("The maximum number of bases per shard.") @Default.Long(1000000) long getBasesPerShard();
Example 20
Source File: NemoPipelineOptions.java From incubator-nemo with Apache License 2.0 | 4 votes |
/** * @return the maximum time to wait before finalising a bundle (in milliseconds). */ @Description("The maximum time to wait before finalising a bundle (in milliseconds).") @Default.Long(1000) Long getMaxBundleTimeMills();