com.yahoo.bullet.dsl

Class BulletDSLConfig

java.lang.Object

com.yahoo.bullet.common.Config

com.yahoo.bullet.common.BulletConfig

com.yahoo.bullet.dsl.BulletDSLConfig

All Implemented Interfaces:

Serializable

public class BulletDSLConfig
extends com.yahoo.bullet.common.BulletConfig

Config class for BulletDSL.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	AVRO_DESERIALIZER_CLASS_NAME
static String	CONNECTOR_ASYNC_COMMIT_ENABLE
static String	CONNECTOR_CLASS_NAME
static String	CONNECTOR_KAFKA_BOOTSTRAP_SERVERS
static String	CONNECTOR_KAFKA_ENABLE_AUTO_COMMIT
static String	CONNECTOR_KAFKA_GROUP_ID
static String	CONNECTOR_KAFKA_KEY_DESERIALIZER
static String	CONNECTOR_KAFKA_NAMESPACE
static String	CONNECTOR_KAFKA_START_AT_END_ENABLE
static String	CONNECTOR_KAFKA_TOPICS
static String	CONNECTOR_KAFKA_VALUE_DESERIALIZER
static String	CONNECTOR_PULSAR_AUTH_ENABLE
static String	CONNECTOR_PULSAR_AUTH_PARAMS_STRING
static String	CONNECTOR_PULSAR_AUTH_PLUGIN_CLASS_NAME
static String	CONNECTOR_PULSAR_CLIENT_NAMESPACE
static String	CONNECTOR_PULSAR_CLIENT_SERVICE_URL
static String	CONNECTOR_PULSAR_CONSUMER_NAMESPACE
static String	CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_NAME
static String	CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_TYPE
static String	CONNECTOR_PULSAR_SCHEMA_CLASS_NAME
static String	CONNECTOR_PULSAR_SCHEMA_TYPE
static String	CONNECTOR_PULSAR_TOPICS
static String	CONNECTOR_READ_TIMEOUT_MS
static boolean	DEFAULT_CONNECTOR_ASYNC_COMMIT_ENABLE
static boolean	DEFAULT_CONNECTOR_KAFKA_ENABLE_AUTO_COMMIT
static boolean	DEFAULT_CONNECTOR_KAFKA_START_AT_END_ENABLE
static boolean	DEFAULT_CONNECTOR_PULSAR_AUTH_ENABLE
static String	DEFAULT_CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_TYPE
static String	DEFAULT_CONNECTOR_PULSAR_SCHEMA_TYPE
static int	DEFAULT_CONNECTOR_READ_TIMEOUT_MS
static boolean	DEFAULT_CONVERTER_AVRO_STRING_TYPE_FIX_ENABLE
static boolean	DEFAULT_CONVERTER_TYPE_CHECK_ENABLE
static String	DEFAULT_DSL_CONFIGURATION
static String	DESERIALIZER_AVRO_CLASS_NAME
static String	DESERIALIZER_AVRO_SCHEMA_FILE
static String	DESERIALIZER_CLASS_NAME
static String	FILE_PREFIX
static String	KAFKA_CONNECTOR_CLASS_NAME
static String	POJO_CONVERTER_CLASS_NAME
static String	PULSAR_CONNECTOR_CLASS_NAME
static String	PULSAR_SCHEMA_AVRO
static String	PULSAR_SCHEMA_BYTES
static Set<String>	PULSAR_SCHEMA_CLASS_REQUIRED_TYPES
static String	PULSAR_SCHEMA_CUSTOM
static String	PULSAR_SCHEMA_JSON
static String	PULSAR_SCHEMA_PROTOBUF
static String	PULSAR_SCHEMA_STRING
static Set<String>	PULSAR_SCHEMA_TYPES
static String	RECORD_CONVERTER_AVRO_STRING_TYPE_FIX_ENABLE
static String	RECORD_CONVERTER_CLASS_NAME
static String	RECORD_CONVERTER_POJO_CLASS_NAME
static String	RECORD_CONVERTER_SCHEMA_FILE
static String	RECORD_CONVERTER_SCHEMA_TYPE_CHECK_ENABLE

Fields inherited from class com.yahoo.bullet.common.BulletConfig

AGGREGATION_COMPOSITE_FIELD_SEPARATOR, AGGREGATION_DEFAULT_SIZE, AGGREGATION_MAX_SIZE, ALPHA_SKETCH_FAMILY, COUNT_DISTINCT_AGGREGATION_SKETCH_ENTRIES, COUNT_DISTINCT_AGGREGATION_SKETCH_FAMILY, COUNT_DISTINCT_AGGREGATION_SKETCH_RESIZE_FACTOR, COUNT_DISTINCT_AGGREGATION_SKETCH_SAMPLING, DEFAULT_AGGREGATION_COMPOSITE_FIELD_SEPARATOR, DEFAULT_AGGREGATION_MAX_SIZE, DEFAULT_AGGREGATION_SIZE, DEFAULT_CONFIGURATION_NAME, DEFAULT_COUNT_DISTINCT_AGGREGATION_SKETCH_ENTRIES, DEFAULT_COUNT_DISTINCT_AGGREGATION_SKETCH_FAMILY, DEFAULT_COUNT_DISTINCT_AGGREGATION_SKETCH_RESIZE_FACTOR, DEFAULT_COUNT_DISTINCT_AGGREGATION_SKETCH_SAMPLING, DEFAULT_DISTRIBUTION_AGGREGATION_GENERATED_POINTS_ROUNDING, DEFAULT_DISTRIBUTION_AGGREGATION_MAX_POINTS, DEFAULT_DISTRIBUTION_AGGREGATION_SKETCH_ENTRIES, DEFAULT_EQUALITY_PARTITIONER_DELIMITER, DEFAULT_GROUP_AGGREGATION_MAX_SIZE, DEFAULT_GROUP_AGGREGATION_SKETCH_ENTRIES, DEFAULT_GROUP_AGGREGATION_SKETCH_RESIZE_FACTOR, DEFAULT_GROUP_AGGREGATION_SKETCH_SAMPLING, DEFAULT_PUBSUB_CLASS_NAME, DEFAULT_PUBSUB_CONTEXT_NAME, DEFAULT_QUERY_DURATION, DEFAULT_QUERY_MAX_DURATION, DEFAULT_QUERY_PARTITIONER_CLASS_NAME, DEFAULT_QUERY_PARTITIONER_ENABLE, DEFAULT_RATE_LIMIT_ENABLE, DEFAULT_RATE_LIMIT_MAX_EMIT_COUNT, DEFAULT_RATE_LIMIT_TIME_INTERVAL, DEFAULT_RAW_AGGREGATION_MAX_SIZE, DEFAULT_RECORD_PROVIDER_CLASS_NAME, DEFAULT_RESULT_METADATA_ENABLE, DEFAULT_RESULT_METADATA_METRICS, DEFAULT_TOP_K_AGGREGATION_SKETCH_ENTRIES, DEFAULT_TOP_K_AGGREGATION_SKETCH_ERROR_TYPE, DEFAULT_WINDOW_DISABLE, DEFAULT_WINDOW_MIN_EMIT_EVERY, DISTRIBUTION_AGGREGATION_GENERATED_POINTS_ROUNDING, DISTRIBUTION_AGGREGATION_MAX_POINTS, DISTRIBUTION_AGGREGATION_SKETCH_ENTRIES, EQUALITY_PARTITIONER_DELIMITER, EQUALITY_PARTITIONER_FIELDS, GROUP_AGGREGATION_MAX_SIZE, GROUP_AGGREGATION_SKETCH_ENTRIES, GROUP_AGGREGATION_SKETCH_RESIZE_FACTOR, GROUP_AGGREGATION_SKETCH_SAMPLING, MAXIMUM_EQUALITY_FIELDS, METRIC_PUBLISHER_CLASS_NAME, PUBSUB_CLASS_NAME, PUBSUB_CONTEXT_NAME, QUERY_DEFAULT_DURATION, QUERY_MAX_DURATION, QUERY_PARTITIONER_CLASS_NAME, QUERY_PARTITIONER_ENABLE, QUICKSELECT_SKETCH_FAMILY, RATE_LIMIT_ENABLE, RATE_LIMIT_MAX_EMIT_COUNT, RATE_LIMIT_TIME_INTERVAL, RAW_AGGREGATION_MAX_SIZE, RECORD_PROVIDER_CLASS_NAME, RECORD_SCHEMA_FILE_NAME, RESULT_METADATA_ENABLE, RESULT_METADATA_METRICS, RESULT_METADATA_METRICS_CONCEPT_KEY, RESULT_METADATA_METRICS_NAME_KEY, STORAGE_CLASS_NAME, TOP_K_AGGREGATION_SKETCH_ENTRIES, TOP_K_AGGREGATION_SKETCH_ERROR_TYPE, WINDOW_DISABLE, WINDOW_MIN_EMIT_EVERY

Fields inherited from class com.yahoo.bullet.common.Config

DELIMITER

Constructor Summary

Constructors

Constructor and Description
BulletDSLConfig() Constructor that loads the defaults.
BulletDSLConfig(com.yahoo.bullet.common.Config other) Constructor that loads another configuration and augments it with defaults.
BulletDSLConfig(String file) Constructor that loads specific file augmented with defaults.

Method Summary

Modifier and Type	Method and Description
com.yahoo.bullet.common.BulletConfig	validate()

Methods inherited from class com.yahoo.bullet.common.BulletConfig

getBulletRecordProvider, getSchema, getValidator, loadConfiguredClass, merge

Methods inherited from class com.yahoo.bullet.common.Config

clear, get, getAll, getAllBut, getAllWithPrefix, getAs, getOrDefault, getOrDefaultAs, getRequiredConfigAs, readYAML, set, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

CONNECTOR_CLASS_NAME

public static final String CONNECTOR_CLASS_NAME

See Also:

Constant Field Values

CONNECTOR_ASYNC_COMMIT_ENABLE

public static final String CONNECTOR_ASYNC_COMMIT_ENABLE

See Also:

Constant Field Values

CONNECTOR_READ_TIMEOUT_MS

public static final String CONNECTOR_READ_TIMEOUT_MS

See Also:

Constant Field Values

CONNECTOR_KAFKA_NAMESPACE

public static final String CONNECTOR_KAFKA_NAMESPACE

See Also:

Constant Field Values

CONNECTOR_PULSAR_CLIENT_NAMESPACE

public static final String CONNECTOR_PULSAR_CLIENT_NAMESPACE

See Also:

Constant Field Values

CONNECTOR_PULSAR_CONSUMER_NAMESPACE

public static final String CONNECTOR_PULSAR_CONSUMER_NAMESPACE

See Also:

Constant Field Values

CONNECTOR_KAFKA_BOOTSTRAP_SERVERS

public static final String CONNECTOR_KAFKA_BOOTSTRAP_SERVERS

See Also:

Constant Field Values

CONNECTOR_KAFKA_GROUP_ID

public static final String CONNECTOR_KAFKA_GROUP_ID

See Also:

Constant Field Values

CONNECTOR_KAFKA_ENABLE_AUTO_COMMIT

public static final String CONNECTOR_KAFKA_ENABLE_AUTO_COMMIT

See Also:

Constant Field Values

CONNECTOR_KAFKA_KEY_DESERIALIZER

public static final String CONNECTOR_KAFKA_KEY_DESERIALIZER

See Also:

Constant Field Values

CONNECTOR_KAFKA_VALUE_DESERIALIZER

public static final String CONNECTOR_KAFKA_VALUE_DESERIALIZER

See Also:

Constant Field Values

CONNECTOR_KAFKA_TOPICS

public static final String CONNECTOR_KAFKA_TOPICS

See Also:

Constant Field Values

CONNECTOR_KAFKA_START_AT_END_ENABLE

public static final String CONNECTOR_KAFKA_START_AT_END_ENABLE

See Also:

Constant Field Values

CONNECTOR_PULSAR_CLIENT_SERVICE_URL

public static final String CONNECTOR_PULSAR_CLIENT_SERVICE_URL

See Also:

Constant Field Values

CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_NAME

public static final String CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_NAME

See Also:

Constant Field Values

CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_TYPE

public static final String CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_TYPE

See Also:

Constant Field Values

CONNECTOR_PULSAR_AUTH_ENABLE

public static final String CONNECTOR_PULSAR_AUTH_ENABLE

See Also:

Constant Field Values

CONNECTOR_PULSAR_AUTH_PLUGIN_CLASS_NAME

public static final String CONNECTOR_PULSAR_AUTH_PLUGIN_CLASS_NAME

See Also:

Constant Field Values

CONNECTOR_PULSAR_AUTH_PARAMS_STRING

public static final String CONNECTOR_PULSAR_AUTH_PARAMS_STRING

See Also:

Constant Field Values

CONNECTOR_PULSAR_TOPICS

public static final String CONNECTOR_PULSAR_TOPICS

See Also:

Constant Field Values

CONNECTOR_PULSAR_SCHEMA_TYPE

public static final String CONNECTOR_PULSAR_SCHEMA_TYPE

See Also:

Constant Field Values

CONNECTOR_PULSAR_SCHEMA_CLASS_NAME

public static final String CONNECTOR_PULSAR_SCHEMA_CLASS_NAME

See Also:

Constant Field Values

PULSAR_SCHEMA_BYTES

public static final String PULSAR_SCHEMA_BYTES

See Also:

Constant Field Values

PULSAR_SCHEMA_STRING

public static final String PULSAR_SCHEMA_STRING

See Also:

Constant Field Values

PULSAR_SCHEMA_JSON

public static final String PULSAR_SCHEMA_JSON

See Also:

Constant Field Values

PULSAR_SCHEMA_AVRO

public static final String PULSAR_SCHEMA_AVRO

See Also:

Constant Field Values

PULSAR_SCHEMA_PROTOBUF

public static final String PULSAR_SCHEMA_PROTOBUF

See Also:

Constant Field Values

PULSAR_SCHEMA_CUSTOM

public static final String PULSAR_SCHEMA_CUSTOM

See Also:

Constant Field Values

PULSAR_SCHEMA_TYPES

public static final Set<String> PULSAR_SCHEMA_TYPES

PULSAR_SCHEMA_CLASS_REQUIRED_TYPES

public static final Set<String> PULSAR_SCHEMA_CLASS_REQUIRED_TYPES

RECORD_CONVERTER_CLASS_NAME

public static final String RECORD_CONVERTER_CLASS_NAME

See Also:

Constant Field Values

RECORD_CONVERTER_SCHEMA_FILE

public static final String RECORD_CONVERTER_SCHEMA_FILE

See Also:

Constant Field Values

RECORD_CONVERTER_SCHEMA_TYPE_CHECK_ENABLE

public static final String RECORD_CONVERTER_SCHEMA_TYPE_CHECK_ENABLE

See Also:

Constant Field Values

RECORD_CONVERTER_POJO_CLASS_NAME

public static final String RECORD_CONVERTER_POJO_CLASS_NAME

See Also:

Constant Field Values

RECORD_CONVERTER_AVRO_STRING_TYPE_FIX_ENABLE

public static final String RECORD_CONVERTER_AVRO_STRING_TYPE_FIX_ENABLE

See Also:

Constant Field Values

DESERIALIZER_CLASS_NAME

public static final String DESERIALIZER_CLASS_NAME

See Also:

Constant Field Values

DESERIALIZER_AVRO_CLASS_NAME

public static final String DESERIALIZER_AVRO_CLASS_NAME

See Also:

Constant Field Values

DESERIALIZER_AVRO_SCHEMA_FILE

public static final String DESERIALIZER_AVRO_SCHEMA_FILE

See Also:

Constant Field Values

KAFKA_CONNECTOR_CLASS_NAME

public static final String KAFKA_CONNECTOR_CLASS_NAME

PULSAR_CONNECTOR_CLASS_NAME

public static final String PULSAR_CONNECTOR_CLASS_NAME

POJO_CONVERTER_CLASS_NAME

public static final String POJO_CONVERTER_CLASS_NAME

AVRO_DESERIALIZER_CLASS_NAME

public static final String AVRO_DESERIALIZER_CLASS_NAME

DEFAULT_DSL_CONFIGURATION

public static final String DEFAULT_DSL_CONFIGURATION

See Also:

Constant Field Values

DEFAULT_CONNECTOR_ASYNC_COMMIT_ENABLE

public static final boolean DEFAULT_CONNECTOR_ASYNC_COMMIT_ENABLE

See Also:

Constant Field Values

DEFAULT_CONNECTOR_READ_TIMEOUT_MS

public static final int DEFAULT_CONNECTOR_READ_TIMEOUT_MS

See Also:

Constant Field Values

DEFAULT_CONNECTOR_KAFKA_ENABLE_AUTO_COMMIT

public static final boolean DEFAULT_CONNECTOR_KAFKA_ENABLE_AUTO_COMMIT

See Also:

Constant Field Values

DEFAULT_CONNECTOR_KAFKA_START_AT_END_ENABLE

public static final boolean DEFAULT_CONNECTOR_KAFKA_START_AT_END_ENABLE

See Also:

Constant Field Values

DEFAULT_CONNECTOR_PULSAR_SCHEMA_TYPE

public static final String DEFAULT_CONNECTOR_PULSAR_SCHEMA_TYPE

See Also:

Constant Field Values

DEFAULT_CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_TYPE

public static final String DEFAULT_CONNECTOR_PULSAR_CONSUMER_SUBSCRIPTION_TYPE

See Also:

Constant Field Values

DEFAULT_CONNECTOR_PULSAR_AUTH_ENABLE

public static final boolean DEFAULT_CONNECTOR_PULSAR_AUTH_ENABLE

See Also:

Constant Field Values

DEFAULT_CONVERTER_TYPE_CHECK_ENABLE

public static final boolean DEFAULT_CONVERTER_TYPE_CHECK_ENABLE

See Also:

Constant Field Values

DEFAULT_CONVERTER_AVRO_STRING_TYPE_FIX_ENABLE

public static final boolean DEFAULT_CONVERTER_AVRO_STRING_TYPE_FIX_ENABLE

See Also:

Constant Field Values

FILE_PREFIX

public static final String FILE_PREFIX

See Also:

Constant Field Values

Constructor Detail

BulletDSLConfig

public BulletDSLConfig()

Constructor that loads the defaults.

BulletDSLConfig

public BulletDSLConfig(String file)

Constructor that loads specific file augmented with defaults.

Parameters:

file - The YAML file to load.

BulletDSLConfig

public BulletDSLConfig(com.yahoo.bullet.common.Config other)

Constructor that loads another configuration and augments it with defaults.

Parameters:

other - The other configuration to wrap.

Method Detail

validate

public com.yahoo.bullet.common.BulletConfig validate()

Overrides:

validate in class com.yahoo.bullet.common.BulletConfig