Multiple activation functions in the same layer
by baton_senger44 - Tuesday January 9, 2024 at 09:45 PM
#1
Is it possible to use more than one activation function in the same layer in a ml model? Like, for example, can I use both ReLU and sigmoid in the same hidden layer? And if I do that, would that make the model more similar to a brain neuron? I'd guess a brain neuron isn't just one function.
I know that activation functions are used to introduce non-linearity and mimic the firing of neurons, but I'm not sure if using different ones in the same layer would make any sense or have any benefits.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  [GUIDE] How Open and view .Sql and JSON Data Lavi 33 7,289 Feb 09, 2026, 09:36 PM
Last Post: gopoo2
  UpViral – Viral Hacking Masterclass Download spanko73 0 45 Jan 26, 2026, 12:07 AM
Last Post: spanko73
  LINUX COMMAND secretleakbuyer 3 1,626 Dec 30, 2025, 11:46 AM
Last Post: 888
  Best AI Checkpoints for Photo realism. DredgenSun 12 2,615 Apr 14, 2025, 09:48 AM
Last Post: DredgenSun
  Mix Courses Collection | 100+ GB moron 15 3,174 Apr 13, 2025, 09:34 PM
Last Post: wared

Forum Jump:


 Users browsing this forum: 1 Guest(s)