Machine learning functions#
Примечание
Ниже приведена оригинальная документация Trino. Скоро мы ее переведем на русский язык и дополним полезными примерами.
The machine learning plugin provides machine learning functionality as an aggregation function. It enables you to train Support Vector Machine (SVM) based classifiers and regressors for the supervised learning problems.
Примечание
The machine learning functions are not optimized for distributed processing. The capability to train large data sets is limited by this execution of the final training on a single instance.
Feature vector#
To solve a problem with the machine learning technique, especially as a
supervised learning problem, it is necessary to represent the data set
with the sequence of pairs of labels and feature vector. A label is a
target value you want to predict from the unseen feature and a feature is a
A N-dimensional vector whose elements are numerical values. In Trino, a
feature vector is represented as a map-type value, whose key is an index
of each feature, so that it can express a sparse vector.
Since classifiers and regressors can recognize the map-type feature
vector, there is a function to construct the feature from the existing
numerical values, features():
SELECT features(1.0, 2.0, 3.0) AS features;
features
-----------------------
{0=1.0, 1=2.0, 2=3.0}
The output from features() can be directly passed to ML functions.
Classification#
Classification is a type of supervised learning problem to predict the distinct label from the given feature vector. The interface looks similar to the construction of the SVM model from the sequence of pairs of labels and features implemented in Teradata Aster or BigQuery ML. The function to train a classification model looks like as follows:
SELECT
learn_classifier(
species,
features(sepal_length, sepal_width, petal_length, petal_width)
) AS model
FROM
iris
It returns the trained model in a serialized format.
model
-------------------------------------------------
3c 43 6c 61 73 73 69 66 69 65 72 28 76 61 72 63
68 61 72 29 3e
classify() returns the predicted label by using the trained model.
The trained model can not be saved natively, and needs to be passed in
the format of a nested query:
SELECT
classify(features(5.9, 3, 5.1, 1.8), model) AS predicted_label
FROM (
SELECT
learn_classifier(species, features(sepal_length, sepal_width, petal_length, petal_width)) AS model
FROM
iris
) t
predicted_label
-----------------
Iris-virginica
As a result you need to run the training process at the same time when predicting values.
Internally, the model is trained by libsvm.
You can use learn_libsvm_classifier() to control the internal parameters of the model.
Regression#
Regression is another type of supervised learning problem, predicting continuous
value, unlike the classification problem. The target must be numerical values that can
be described as double.
The following code shows the creation of the model predicting sepal_length
from the other 3 features:
SELECT
learn_regressor(sepal_length, features(sepal_width, petal_length, petal_width)) AS model
FROM
iris
The way to use the model is similar to the classification case:
SELECT
regress(features(3, 5.1, 1.8), model) AS predicted_target
FROM (
SELECT
learn_regressor(sepal_length, features(sepal_width, petal_length, petal_width)) AS model
FROM iris
) t;
predicted_target
-------------------
6.407376822560477
Internally, the model is trained by libsvm.
learn_libsvm_regressor() provides you a way to control the training process.
Machine learning functions#
- features(double, ...) -> map(bigint, double)#
Returns the map representing the feature vector.
- learn_classifier(label, features) Classifier#
Returns an SVM-based classifier model, trained with the given label and feature data sets.
- learn_libsvm_classifier(label, features, params) Classifier#
Returns an SVM-based classifier model, trained with the given label and feature data sets. You can control the training process by libsvm parameters.
- classify(features, model) label#
Returns a label predicted by the given classifier SVM model.
- learn_regressor(target, features) Regressor#
Returns an SVM-based regressor model, trained with the given target and feature data sets.
- learn_libsvm_regressor(target, features, params) Regressor#
Returns an SVM-based regressor model, trained with the given target and feature data sets. You can control the training process by libsvm parameters.
- regress(features, model) target#
Returns a predicted target value by the given regressor SVM model.