Sinusoid Unit
•
Nonmonotonic and
periodic
•
McCaughan (1997)
has shown that it
can be trained
using GDR, is very
powerful
, and leads
to interpretable
nets