Java Code Examples for org.apache.beam.sdk.options.Default#Long

The following examples show how to use org.apache.beam.sdk.options.Default#Long . You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source File: BigQueryOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The maximum byte size of a single streaming insert to BigQuery.")
@Default.Long(64L * 1024L)
Long getMaxStreamingBatchSize();
 
Example 2
Source File: SamzaPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The interval to check for watermarks in milliseconds.")
@Default.Long(1000)
long getWatermarkInterval();
 
Example 3
Source File: FlinkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The maximum number of elements in a bundle.")
@Default.Long(1000)
Long getMaxBundleSize();
 
Example 4
Source File: FlinkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "The maximum time in milliseconds that a checkpoint may take before being discarded.")
@Default.Long(-1L)
Long getCheckpointTimeoutMillis();
 
Example 5
Source File: SamzaPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The maximum time to wait before finalising a bundle (in milliseconds).")
@Default.Long(1000)
long getMaxBundleTimeMs();
 
Example 6
Source File: SparkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "If set bundleSize will be used for splitting BoundedSources, otherwise default to "
        + "splitting BoundedSources on Spark defaultParallelism. Most effective when used with "
        + "Spark dynamicAllocation.")
@Default.Long(0)
Long getBundleSize();
 
Example 7
Source File: SparkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "The period to checkpoint (in Millis). If not set, Spark will default "
        + "to Max(slideDuration, Seconds(10)). This PipelineOptions default (-1) will end-up "
        + "with the described Spark default.")
@Default.Long(-1)
Long getCheckpointDurationMillis();
 
Example 8
Source File: SparkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Max records per micro-batch. For streaming sources only.")
@Default.Long(-1)
Long getMaxRecordsPerBatch();
 
Example 9
Source File: FlinkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description(
    "Sets the delay in milliseconds between executions. A value of {@code -1} "
        + "indicates that the default value should be used.")
@Default.Long(-1L)
Long getExecutionRetryDelay();
 
Example 10
Source File: SparkPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("Batch interval for Spark streaming in milliseconds.")
@Default.Long(500)
Long getBatchIntervalMillis();
 
Example 11
Source File: LoadData.java    From java-docs-samples with Apache License 2.0 4 votes vote down vote up
@Description("The number of megabytes per row to write")
@Default.Long(5)
long getMegabytesPerRow();
 
Example 12
Source File: BigQueryOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Description("The maximum number of rows to batch in a single streaming insert to BigQuery.")
@Default.Long(500)
Long getMaxStreamingRowsToBatch();
 
Example 13
Source File: TestPipelineOptions.java    From beam with Apache License 2.0 4 votes vote down vote up
@Default.Long(10 * 60)
@Nullable
Long getTestTimeoutSeconds();
 
Example 14
Source File: ReadData.java    From java-docs-samples with Apache License 2.0 4 votes vote down vote up
@Description("The number of megabytes per row written using the load data script.")
@Default.Long(5)
long getMegabytesPerRow();
 
Example 15
Source File: KeyReadsFn.java    From dataflow-java with Apache License 2.0 4 votes vote down vote up
@Description("Loci per writing shard")
@Default.Long(10000)
long getLociPerWritingShard();
 
Example 16
Source File: ElasticsearchTransforms.java    From DataflowTemplates with Apache License 2.0 4 votes vote down vote up
@Description("Batch size in number of documents. Default: 1000")
@Default.Long(1000)
Long getBatchSize();
 
Example 17
Source File: PubSubToMongoDB.java    From DataflowTemplates with Apache License 2.0 4 votes vote down vote up
@Description("Batch size in number of bytes. Default: 5242880 (5mb)")
@Default.Long(5242880)
Long getBatchSizeBytes();
 
Example 18
Source File: PubSubToMongoDB.java    From DataflowTemplates with Apache License 2.0 4 votes vote down vote up
@Description("Batch size in number of documents. Default: 1000")
@Default.Long(1024)
Long getBatchSize();
 
Example 19
Source File: ShardOptions.java    From dataflow-java with Apache License 2.0 4 votes vote down vote up
@Description("The maximum number of bases per shard.")
@Default.Long(1000000)
long getBasesPerShard();
 
Example 20
Source File: NemoPipelineOptions.java    From incubator-nemo with Apache License 2.0 4 votes vote down vote up
/**
 * @return the maximum time to wait before finalising a bundle (in milliseconds).
 */
@Description("The maximum time to wait before finalising a bundle (in milliseconds).")
@Default.Long(1000)
Long getMaxBundleTimeMills();