Ug;dZddlZddlmZmZddlZddlmZ ddl m Z ddl m Z mZmZmZddlmZmZddlmZdd lmZdd lmZGd d eee ZdS) zRestricted Boltzmann MachineN)IntegralReal)expit) BaseEstimatorClassNamePrefixFeaturesOutMixinTransformerMixin _fit_context)check_random_stategen_even_slices)Interval)safe_sparse_dot)check_is_fittedc JeZdZUdZeedddgeedddgeedddgeedddgdgd gd Zee d < dd ddddddZ dZ dZ dZ dZdZdZedddZdZdZedddZdZdS) BernoulliRBMaBernoulli Restricted Boltzmann Machine (RBM). A Restricted Boltzmann Machine with binary visible units and binary hidden units. Parameters are estimated using Stochastic Maximum Likelihood (SML), also known as Persistent Contrastive Divergence (PCD) [2]. The time complexity of this implementation is ``O(d ** 2)`` assuming d ~ n_features ~ n_components. Read more in the :ref:`User Guide `. Parameters ---------- n_components : int, default=256 Number of binary hidden units. learning_rate : float, default=0.1 The learning rate for weight updates. It is *highly* recommended to tune this hyper-parameter. Reasonable values are in the 10**[0., -3.] range. batch_size : int, default=10 Number of examples per minibatch. n_iter : int, default=10 Number of iterations/sweeps over the training dataset to perform during training. verbose : int, default=0 The verbosity level. The default, zero, means silent mode. Range of values is [0, inf]. random_state : int, RandomState instance or None, default=None Determines random number generation for: - Gibbs sampling from visible and hidden layers. - Initializing components, sampling from layers during fit. - Corrupting the data when scoring samples. Pass an int for reproducible results across multiple function calls. See :term:`Glossary `. Attributes ---------- intercept_hidden_ : array-like of shape (n_components,) Biases of the hidden units. intercept_visible_ : array-like of shape (n_features,) Biases of the visible units. components_ : array-like of shape (n_components, n_features) Weight matrix, where `n_features` is the number of visible units and `n_components` is the number of hidden units. h_samples_ : array-like of shape (batch_size, n_components) Hidden Activation sampled from the model distribution, where `batch_size` is the number of examples per minibatch and `n_components` is the number of hidden units. n_features_in_ : int Number of features seen during :term:`fit`. .. versionadded:: 0.24 feature_names_in_ : ndarray of shape (`n_features_in_`,) Names of features seen during :term:`fit`. Defined only when `X` has feature names that are all strings. .. versionadded:: 1.0 See Also -------- sklearn.neural_network.MLPRegressor : Multi-layer Perceptron regressor. sklearn.neural_network.MLPClassifier : Multi-layer Perceptron classifier. sklearn.decomposition.PCA : An unsupervised linear dimensionality reduction model. References ---------- [1] Hinton, G. E., Osindero, S. and Teh, Y. A fast learning algorithm for deep belief nets. Neural Computation 18, pp 1527-1554. https://www.cs.toronto.edu/~hinton/absps/fastnc.pdf [2] Tieleman, T. Training Restricted Boltzmann Machines using Approximations to the Likelihood Gradient. International Conference on Machine Learning (ICML) 2008 Examples -------- >>> import numpy as np >>> from sklearn.neural_network import BernoulliRBM >>> X = np.array([[0, 0, 0], [0, 1, 1], [1, 0, 1], [1, 1, 1]]) >>> model = BernoulliRBM(n_components=2) >>> model.fit(X) BernoulliRBM(n_components=2) For a more detailed example usage, see :ref:`sphx_glr_auto_examples_neural_networks_plot_rbm_logistic_classification.py`. Nleft)closedrneitherverbose random_state n_components learning_rate batch_sizen_iterrr_parameter_constraintsg? )rrrrrcZ||_||_||_||_||_||_dSNr)selfrrrrrrs Z/var/www/surfInsights/venv3-11/lib/python3.11/site-packages/sklearn/neural_network/_rbm.py__init__zBernoulliRBM.__init__s7)*$  (ct|||ddtjtjf}||S)agCompute the hidden layer activation probabilities, P(h=1|v=X). Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) The data to be transformed. Returns ------- h : ndarray of shape (n_samples, n_components) Latent representations of the data. csrF) accept_sparseresetdtype)r_validate_datanpfloat64float32 _mean_hiddens)r"Xs r# transformzBernoulliRBM.transformsT     U% BJ7O   !!!$$$r%clt||jj}||jz }t ||S)aLComputes the probabilities P(h=1|v). Parameters ---------- v : ndarray of shape (n_samples, n_features) Values of the visible layer. Returns ------- h : ndarray of shape (n_samples, n_components) Corresponding mean field values for the hidden layer. out)r components_Tintercept_hidden_r)r"vps r#r/zBernoulliRBM._mean_hiddenss6 At/1 2 2 T ##QAr%cj||}||j|kS)aSample from the distribution P(h|v). Parameters ---------- v : ndarray of shape (n_samples, n_features) Values of the visible layer to sample from. rng : RandomState instance Random number generator to use. Returns ------- h : ndarray of shape (n_samples, n_components) Values of the hidden layer. size)r/uniformshape)r"r8rngr9s r#_sample_hiddenszBernoulliRBM._sample_hiddenss2   q ! !{{{((1,,r%ctj||j}||jz }t ||||j|kS)aSample from the distribution P(v|h). Parameters ---------- h : ndarray of shape (n_samples, n_components) Values of the hidden layer to sample from. rng : RandomState instance Random number generator to use. Returns ------- v : ndarray of shape (n_samples, n_features) Values of the visible layer. r3r;)r,dotr5intercept_visible_rr=r>)r"hr?r9s r#_sample_visibleszBernoulliRBM._sample_visiblessO F1d& ' ' T $$ aQ{{{((1,,r%ct||j tjdt||jj|jzdz S)aFComputes the free energy F(v) = - log sum_h exp(-E(v,h)). Parameters ---------- v : ndarray of shape (n_samples, n_features) Values of the visible layer. Returns ------- free_energy : ndarray of shape (n_samples,) The value of the free energy. rraxis)rrCr, logaddexpr5r6r7sum)r"r8s r# _free_energyzBernoulliRBM._free_energysY 4#:;;;bl q$"2"4558NN? ? #1#++ r%ct|t|dst|j|_|||j}|||j}|S)aTPerform one Gibbs sampling step. Parameters ---------- v : ndarray of shape (n_samples, n_features) Values of the visible layer to start from. Returns ------- v_new : ndarray of shape (n_samples, n_features) Values of the visible layer after one Gibbs step. random_state_)rhasattrr rrMr@rE)r"r8h_v_s r#gibbszBernoulliRBM.gibbssm t_-- G!3D4E!F!FD   ! !!T%7 8 8  " "2t'9 : : r%T)prefer_skip_nested_validationc t|d }||dtj|}t|dst |j|_t|ds^tj|jdd|j |j dfd |_ |j j d|_ t|d stj |j |_t|d s$tj |j d|_t|d s%tj |j|j f|_|||jd S)aFit the model to the partial segment of the data X. Parameters ---------- X : ndarray of shape (n_samples, n_features) Training data. y : array-like of shape (n_samples,) or (n_samples, n_outputs), default=None Target values (None for unsupervised transformations). Returns ------- self : BernoulliRBM The fitted model. r5r')r(r*r)rMr{Gz?rF)orderr7rC h_samples_N)rNr+r,r-r rrMasarraynormalrr>r5_n_features_outzerosr7rCrrW_fit)r"r0y first_passs r# partial_fitzBernoulliRBM.partial_fitsx"!}555    U"*J   t_-- G!3D4E!F!FD t]++ =!z"))!TD4Eqwqz3RSS   D $(#3#9!#rr6r,rBr5r7rJrCrXsqueezer=floor)r"v_posr?h_posv_negh_neglrupdates r#r\zBernoulliRBM._fit=sl""5))%%dos;;""5)) 4% & &Q 7 %dCCCE"&%((( BK' " q (9(9EII1I)rr+r rr,aranger>randintspissparse isinstancematrix csr_matrixAravel csr_arraycopyrKrI) r"r0r8r?inddatarPfefe_s r# score_sampleszBernoulliRBM.score_samples[si&    e  D D !233y$$ckk!QWQZ&L&LM ;q>> "#;?D$ ** J 'r rrXrYrr*r5rZr[r7rCrrWintceilrblistr rtimerangerr\printtype__name__r|mean) r"r0r]r~r? n_batches batch_slicesrbegin iteration batch_sliceends r#fitzBernoulliRBM.fits"   rz2:>V  W WGAJ  !233: JJq$!2AGAJ ? @ @'    $/5a8!#$*;17!K!K!K"$(171:QW"E"E"E(DOT5F#GqwWWWi 0 04? BCCDD  I7i X X X  , q$+/22  I+ / /  !K.#.... ikkOT +!**1--2244e  r%c>dddtjtjgdS)Nz&fails for the decision_function methodz"fails for the score_samples method)check_methods_subset_invariance%check_methods_sample_order_invariance) _xfail_checkspreserves_dtype)r,r-r.)r"s r# _more_tagszBernoulliRBM._more_tagss3=9 !# BJ7   r%)rr!)r __module__ __qualname____doc__r rrrdict__annotations__r$r1r/r@rErKrQr r_r\r|rrr%r#rrsggT"(AtFCCCD"(4DCCCDx!T&AAAB8Haf===>;'( $$D))))))"%%%("---&---*"*\555')')')65')R111<':':':R\555555655n      r%r)rrnumbersrrnumpyr, scipy.sparsesparsero scipy.specialrbaserrr r utilsr r utils._param_validationr utils.extmathrutils.validationrrrr%r#rs."" """""""" 87777777......++++++......k k k k k 24Dmk k k k k r%