Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update pytorch_feedforward_neuralnetwork.md #15

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Walser52
Copy link

@Walser52 Walser52 commented Jun 7, 2022

Activation saturates at 0 or 1 with gradients $\approx$ 0
should be:
Activation saturates at -1 or 1 with gradients $\approx$ 0

Activation saturates at 0 or 1 with **gradients $\approx$ 0**
should be:
Activation saturates at -1 or 1 with **gradients $\approx$ 0**
@ritchieng
Copy link
Owner

I know this was an old pull request.

But why do you want to change the range from 0,1 to -1,1?

For extremely large negative values of $x$, then $e^{-x}$ approaches infinite. Hence $\theta(x)$ approaches 0.

@kenn
Copy link

kenn commented Feb 20, 2024

Folks, I think this is a scam. Don't allow them to access your company's private repos to them, okay? It's easy to imagine the code analysis being used for hacking and ransomware on your products.

How should we report this to Github?

@ritchieng
Copy link
Owner

Folks, I think this is a scam. Don't click or link your Github account to them, okay?

How should we report this to Github?

Thank you, I've reported the user via the report feature and marked his comment as spam to hide the contents. Thanks for alerting me to this!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants