dask_ml.preprocessing
.StandardScaler¶

class
dask_ml.preprocessing.
StandardScaler
(*, copy=True, with_mean=True, with_std=True)¶ Standardize features by removing the mean and scaling to unit variance
The standard score of a sample x is calculated as:
z = (x  u) / swhere u is the mean of the training samples or zero if with_mean=False, and s is the standard deviation of the training samples or one if with_std=False.
Centering and scaling happen independently on each feature by computing the relevant statistics on the samples in the training set. Mean and standard deviation are then stored to be used on later data using
transform()
.Standardization of a dataset is a common requirement for many machine learning estimators: they might behave badly if the individual features do not more or less look like standard normally distributed data (e.g. Gaussian with 0 mean and unit variance).
For instance many elements used in the objective function of a learning algorithm (such as the RBF kernel of Support Vector Machines or the L1 and L2 regularizers of linear models) assume that all features are centered around 0 and have variance in the same order. If a feature has a variance that is orders of magnitude larger that others, it might dominate the objective function and make the estimator unable to learn from other features correctly as expected.
This scaler can also be applied to sparse CSR or CSC matrices by passing with_mean=False to avoid breaking the sparsity structure of the data.
Read more in the User Guide.
Parameters:  copy : bool, default=True
If False, try to avoid a copy and do inplace scaling instead. This is not guaranteed to always work inplace; e.g. if the data is not a NumPy array or scipy.sparse CSR matrix, a copy may still be returned.
 with_mean : bool, default=True
If True, center the data before scaling. This does not work (and will raise an exception) when attempted on sparse matrices, because centering them entails building a dense matrix which in common use cases is likely to be too large to fit in memory.
 with_std : bool, default=True
If True, scale the data to unit variance (or equivalently, unit standard deviation).
Attributes:  scale_ : ndarray of shape (n_features,) or None
Per feature relative scaling of the data to achieve zero mean and unit variance. Generally this is calculated using np.sqrt(var_). If a variance is zero, we can’t achieve unit variance, and the data is left asis, giving a scaling factor of 1. scale_ is equal to None when with_std=False.
New in version 0.17: scale_
 mean_ : ndarray of shape (n_features,) or None
The mean value for each feature in the training set. Equal to
None
whenwith_mean=False
. var_ : ndarray of shape (n_features,) or None
The variance for each feature in the training set. Used to compute scale_. Equal to
None
whenwith_std=False
. n_samples_seen_ : int or ndarray of shape (n_features,)
The number of samples processed by the estimator for each feature. If there are no missing samples, the
n_samples_seen
will be an integer, otherwise it will be an array of dtype int. If sample_weights are used it will be a float (if no missing data) or an array of dtype float that sums the weights seen so far. Will be reset on new calls to fit, but increments acrosspartial_fit
calls.
See also
scale
 Equivalent function without the estimator API.
PCA
 Further removes the linear correlation across features with ‘whiten=True’.
Notes
NaNs are treated as missing values: disregarded in fit, and maintained in transform.
We use a biased estimator for the standard deviation, equivalent to numpy.std(x, ddof=0). Note that the choice of ddof is unlikely to affect model performance.
For a comparison of the different scalers, transformers, and normalizers, see examples/preprocessing/plot_all_scaling.py.
Examples
>>> from sklearn.preprocessing import StandardScaler >>> data = [[0, 0], [0, 0], [1, 1], [1, 1]] >>> scaler = StandardScaler() >>> print(scaler.fit(data)) StandardScaler() >>> print(scaler.mean_) [0.5 0.5] >>> print(scaler.transform(data)) [[1. 1.] [1. 1.] [ 1. 1.] [ 1. 1.]] >>> print(scaler.transform([[2, 2]])) [[3. 3.]]
Methods
fit
(X, pandas.core.frame.DataFrame, …)Compute the mean and std to be used for later scaling. fit_transform
(X[, y])Fit to data, then transform it. get_params
([deep])Get parameters for this estimator. inverse_transform
(X, …)Scale back the data to the original representation partial_fit
(X, pandas.core.frame.DataFrame, …)Online computation of mean and std on X for later scaling. set_params
(**params)Set the parameters of this estimator. transform
(X, pandas.core.frame.DataFrame, …)Perform standardization by centering and scaling 
__init__
(*, copy=True, with_mean=True, with_std=True)¶ Initialize self. See help(type(self)) for accurate signature.

fit
(X: Union[ArrayLike, pandas.core.frame.DataFrame, dask.dataframe.core.DataFrame], y: Union[ArrayLike, dask.dataframe.core.Series, pandas.core.series.Series, None] = None) → dask_ml.preprocessing.data.StandardScaler¶ Compute the mean and std to be used for later scaling.
Parameters:  X : {arraylike, sparse matrix} of shape (n_samples, n_features)
The data used to compute the mean and standard deviation used for later scaling along the features axis.
 y : None
Ignored.
 sample_weight : arraylike of shape (n_samples,), default=None
Individual weights for each sample.
New in version 0.24: parameter sample_weight support to StandardScaler.
Returns:  self : object
Fitted scaler.

fit_transform
(X, y=None, **fit_params)¶ Fit to data, then transform it.
Fits transformer to X and y with optional parameters fit_params and returns a transformed version of X.
Parameters:  X : arraylike of shape (n_samples, n_features)
Input samples.
 y : arraylike of shape (n_samples,) or (n_samples, n_outputs), default=None
Target values (None for unsupervised transformations).
 **fit_params : dict
Additional fit parameters.
Returns:  X_new : ndarray array of shape (n_samples, n_features_new)
Transformed array.

get_params
(deep=True)¶ Get parameters for this estimator.
Parameters:  deep : bool, default=True
If True, will return the parameters for this estimator and contained subobjects that are estimators.
Returns:  params : dict
Parameter names mapped to their values.

inverse_transform
(X: Union[ArrayLike, pandas.core.frame.DataFrame, dask.dataframe.core.DataFrame], copy: Optional[bool] = None) → Union[ArrayLike, pandas.core.frame.DataFrame, dask.dataframe.core.DataFrame]¶ Scale back the data to the original representation
Parameters:  X : {arraylike, sparse matrix} of shape (n_samples, n_features)
The data used to scale along the features axis.
 copy : bool, default=None
Copy the input X or not.
Returns:  X_tr : {ndarray, sparse matrix} of shape (n_samples, n_features)
Transformed array.

partial_fit
(X: Union[ArrayLike, pandas.core.frame.DataFrame, dask.dataframe.core.DataFrame], y: Union[ArrayLike, dask.dataframe.core.Series, pandas.core.series.Series, None] = None)¶ Online computation of mean and std on X for later scaling.
All of X is processed as a single batch. This is intended for cases when
fit()
is not feasible due to very large number of n_samples or because X is read from a continuous stream.The algorithm for incremental mean and std is given in Equation 1.5a,b in Chan, Tony F., Gene H. Golub, and Randall J. LeVeque. “Algorithms for computing the sample variance: Analysis and recommendations.” The American Statistician 37.3 (1983): 242247:
Parameters:  X : {arraylike, sparse matrix} of shape (n_samples, n_features)
The data used to compute the mean and standard deviation used for later scaling along the features axis.
 y : None
Ignored.
 sample_weight : arraylike of shape (n_samples,), default=None
Individual weights for each sample.
New in version 0.24: parameter sample_weight support to StandardScaler.
Returns:  self : object
Fitted scaler.

set_params
(**params)¶ Set the parameters of this estimator.
The method works on simple estimators as well as on nested objects (such as
Pipeline
). The latter have parameters of the form<component>__<parameter>
so that it’s possible to update each component of a nested object.Parameters:  **params : dict
Estimator parameters.
Returns:  self : estimator instance
Estimator instance.

transform
(X: Union[ArrayLike, pandas.core.frame.DataFrame, dask.dataframe.core.DataFrame], y: Union[ArrayLike, dask.dataframe.core.Series, pandas.core.series.Series, None] = None, copy: Optional[bool] = None) → Union[ArrayLike, pandas.core.frame.DataFrame, dask.dataframe.core.DataFrame]¶ Perform standardization by centering and scaling
Parameters:  X : {arraylike, sparse matrix of shape (n_samples, n_features)
The data used to scale along the features axis.
 copy : bool, default=None
Copy the input X or not.
Returns:  X_tr : {ndarray, sparse matrix} of shape (n_samples, n_features)
Transformed array.