Packages

trait DataProducer extends AnyRef

Trait that can be implemented to produce BulletRecord data as input to Bullet running on Spark Streaming.

This trait is used to plugin users' source of data to Bullet. The data can be from anywhere. For example, Kafka, HDFS, H3, Kinesis etc. This generally involves hooking in a Receiver. Users can also do any transformations on the data before emitting it to Bullet in their own implementations by using the provided Spark Streaming Context. This will be the same context used to wire in the rest of the Bullet DAG.

Linear Supertypes
AnyRef, Any
Known Subclasses
DSLDataProducer
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DataProducer
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def getBulletRecordStream(ssc: StreamingContext, config: BulletSparkConfig): DStream[BulletRecord[_ <: Serializable]]

    Get Bullet record stream from users' source of data.

    Get Bullet record stream from users' source of data.

    In this method, any transformations to the users' data can be done.

    ssc

    The StreamingContext that can be used to define an arbitrary DAG to compute the BulletRecord stream.

    config

    The com.yahoo.bullet.spark.utils.BulletSparkConfig containing all the settings.

    returns

    The BulletRecord stream, which will be used as the input to Bullet.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  14. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  16. def toString(): String
    Definition Classes
    AnyRef → Any
  17. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped