org.apache.flink.runtime.clusterframework.overlays.HadoopConfOverlay Java Examples

The following examples show how to use org.apache.flink.runtime.clusterframework.overlays.HadoopConfOverlay. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source File: MesosEntrypointUtils.java    From Flink-CEPplus with Apache License 2.0 6 votes vote down vote up 
/**
 * Generate a container specification as a TaskManager template.
 *
 * <p>This code is extremely Mesos-specific and registers all the artifacts that the TaskManager
 * needs (such as JAR file, config file, ...) and all environment variables into a container specification.
 * The Mesos fetcher then ensures that those artifacts will be copied into the task's sandbox directory.
 * A lightweight HTTP server serves the artifacts to the fetcher.
 */
public static void applyOverlays(
	Configuration configuration, ContainerSpecification containerSpec) throws IOException {

	// create the overlays that will produce the specification
	CompositeContainerOverlay overlay = new CompositeContainerOverlay(
		FlinkDistributionOverlay.newBuilder().fromEnvironment(configuration).build(),
		HadoopConfOverlay.newBuilder().fromEnvironment(configuration).build(),
		HadoopUserOverlay.newBuilder().fromEnvironment(configuration).build(),
		KeytabOverlay.newBuilder().fromEnvironment(configuration).build(),
		Krb5ConfOverlay.newBuilder().fromEnvironment(configuration).build(),
		SSLStoreOverlay.newBuilder().fromEnvironment(configuration).build()
	);

	// apply the overlays
	overlay.configure(containerSpec);
}
Example #2
Source File: MesosEntrypointUtils.java    From flink with Apache License 2.0 6 votes vote down vote up 
/**
 * Generate a container specification as a TaskManager template.
 *
 * <p>This code is extremely Mesos-specific and registers all the artifacts that the TaskManager
 * needs (such as JAR file, config file, ...) and all environment variables into a container specification.
 * The Mesos fetcher then ensures that those artifacts will be copied into the task's sandbox directory.
 * A lightweight HTTP server serves the artifacts to the fetcher.
 */
public static void applyOverlays(
	Configuration configuration, ContainerSpecification containerSpec) throws IOException {

	// create the overlays that will produce the specification
	CompositeContainerOverlay overlay = new CompositeContainerOverlay(
		FlinkDistributionOverlay.newBuilder().fromEnvironment(configuration).build(),
		HadoopConfOverlay.newBuilder().fromEnvironment(configuration).build(),
		HadoopUserOverlay.newBuilder().fromEnvironment(configuration).build(),
		KeytabOverlay.newBuilder().fromEnvironment(configuration).build(),
		Krb5ConfOverlay.newBuilder().fromEnvironment(configuration).build(),
		SSLStoreOverlay.newBuilder().fromEnvironment(configuration).build()
	);

	// apply the overlays
	overlay.configure(containerSpec);
}
Example #3
Source File: MesosUtils.java    From flink with Apache License 2.0 6 votes vote down vote up 
/**
 * Generate a container specification as a TaskManager template.
 *
 * <p>This code is extremely Mesos-specific and registers all the artifacts that the TaskManager
 * needs (such as JAR file, config file, ...) and all environment variables into a container specification.
 * The Mesos fetcher then ensures that those artifacts will be copied into the task's sandbox directory.
 * A lightweight HTTP server serves the artifacts to the fetcher.
 */
public static void applyOverlays(
	Configuration configuration, ContainerSpecification containerSpec) throws IOException {

	// create the overlays that will produce the specification
	CompositeContainerOverlay overlay = new CompositeContainerOverlay(
		FlinkDistributionOverlay.newBuilder().fromEnvironment(configuration).build(),
		UserLibOverlay.newBuilder().setUsrLibDirectory(ClusterEntrypointUtils.tryFindUserLibDirectory().orElse(null)).build(),
		HadoopConfOverlay.newBuilder().fromEnvironment(configuration).build(),
		HadoopUserOverlay.newBuilder().fromEnvironment(configuration).build(),
		KeytabOverlay.newBuilder().fromEnvironment(configuration).build(),
		Krb5ConfOverlay.newBuilder().fromEnvironment(configuration).build(),
		SSLStoreOverlay.newBuilder().fromEnvironment(configuration).build()
	);

	// apply the overlays
	overlay.configure(containerSpec);
}