Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Confusing expression in description of Simple Network... #38

Open
rtalexander opened this issue Aug 28, 2018 · 1 comment
Open

Confusing expression in description of Simple Network... #38

rtalexander opened this issue Aug 28, 2018 · 1 comment

Comments

@rtalexander
Copy link

Hi,

I find the following description in the Simple Network to be a bit confusing:

Prediction = A(\;A(\;X W_h\;)W_o\;)
Where A is an activation function like :ref:`activation_relu`, X is the input and W_h and W_o are weights.

I think I get your point, namely that the expression on the right hand side of Prediction is the approximate pseudo mathematical expression of the simple network, and where A is used to representation an arbitrary mathematical function that takes a matrix as an argument and that returns a matrix (there's a lot of capital letters in that expression, not all of which are matrices). Unfortunately, for me at least, the use of the capital A is confusing, and takes a few moments to figure out that A is itself not a matrix. It might be clearer to replace A with f or some other lower case letter. Just a suggestion.

@bfortuner
Copy link
Owner

Thank you! Apologies I've been heads down at work. Feel free to post a PR if you think it can be improved! Also looking for fellow maintainers if you're interested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants