Neural-Networks

Explains sparse Mixture-of-Experts (MoE) architecture with conditional computation, router/gate mechanisms, load balancing, and trade-offs vs. dense models.

Foundational neural network architecture covering perceptrons, layers, activation functions, and backpropagation-based training.