Expressive power of binary and ternary neural networks
We show that deep sparse ReLU networks with ternary weights and deep ReLU networks with binary weights can approximate -Hölder functions on . Also, for any interval , continuous functions on can be approximated by networks of depth with binary activation function $\mathds{1}_{[a,b)}$.