weight space

Weight Space

Weight space refers to the high-dimensional space where each point represents a specific configuration of weights in a neural network. For a neural network with $n$ parameters, the weight space is ${\mathbb{R}}^n$, and each specific trained model corresponds to a single point in this space.