Action ML Logo

Table of contents

Architecture

PredictionIO is a Framework for Machine Learning. It provides an API for creating "templates", which implement a particular ML algorithm like a recommender, classifier, or regression analysis. It also provides services that flesh out what is known as a Lambda Architecture. It is primarily built on Spark so several commands rely directly on it. It is not limited to the algorithms that are supplied with Spark.

Lambda in PredictionIO

image

This translates to realtime input and queries—with background re-calculation of models but it also allows realtime data to be used in responding to queries. For example the Universal Recommender uses realtime user behavior to return personalized recommendations.

PredictionIO Processes

From the diagram above you can see that PredictionIO breaks down into:

PredictionIO Component Services

It is important to note that PIO does not store state outside of it's component services, which are all highly scalable and cluster-aware. This means that to scale PIO most of what you must do is scale its component services. These are:

Logical Architecture and Data Flow

The internal architecture of PredictionIO and the data flow for all use modes is shown below.

image

To Illustrate how this flow changes we'll look at each stage separately, they are:

Live Event Input

This is the typical input mode of the system where clients or web app backends are feeding new data to the running system. This data is used by the templates (including The Universal Recommender) in realtime though it requires a pio train to reflect new items or property changes. For the case where new users are sending new events, the template will be able to create results in realtime that use the new user data.

image

Training a Model

In Data Science jargon the template creates a new model from the EventServer's dataset taken as a whole every time pio train is called. This is the background part of the Lambda Architecture. Retraining for many dataset is not needed in anything like realtime since there may be no significant difference between models created. For a recommender the rule of thumb is to train when there are new conversion items since a recommender cannot recommend items that aren't hasn't seem in training data event if it uses realtime user history to recommend to an individual user. So the user's history does not need to be incorporated into the model but the items recommended are limited to the ones in the model.

For the UR a background batch operation is performed and, when it's done, the new model is available to PredictionServers. So no re-deployment is necessary to update a running UR but other templates may require a re-deploy for each train.

image

Queries

Once we have trained the template and stored a model, queries will produce results. Most templates have their own method for generating results with their own requirements. The example below is for the Universal Recommender, which uses Elasticsearch in the query phase.

For the UR each query from the client application results in 2 internal queries one to the EventServer to get user history, and one to Elasticsearch that is created from the user history and the client app query. So if a query only passes in a user-id, the user history is retrieved from the EventServer and this forms most of Elasticsearch query. Only one query is made to Elasticsearch with all params needed. Once Elasticsearch returns items they are passed back to the client application.

image

Bootstrapping Batch Import

On-boarding new data can be accomplished by creating JSON event files. These are a form of JSON that is directly supported by Spark. Each event is encoded in a JSON object—one per line. Normally JSON would require this to be in an array but Spark requires that each line contain the object so lines can be read in parallel. The JSON can be created of the same form that is exported from the EventServer as a backup.

If you have used one of the Universal Recommender integration tests like examples/integration-test you will have example data in the EventServer. For other templates if you have data in the EventStore issue a pio export ... command to see the format. You don't have to create the event id or creationDate but you should create the eventDate if possible. See the template documentation for exact data require for input.

Alternatively you can use an SDK or the REST API to send events to the running EventServer, just as you would with the live event stream in production. In this case the Events do not come from files.

image