DropConnect

DropConnect is a regularization technique where each weight+bias has a probability $p$ of being $0$.

$$r=a((M\cdot W)v)$$

$r\dots$ layer output
$v\dots$ layer input
$W\dots$ weight matrix
$M\dots$ binary marix with connection information

$$M_{ij}\sim \text{Bernoulli}(p)$$

References

https://paperswithcode.com/method/dropconnect