Non-standard activation functions (such as Swish, variants of GELU, or custom gating mechanisms), attention mechanism variants (asymmetric Q/K/V dimensions or the introduction of additional scaling factors), and dynamic routing layers (such as the routing protocol of Capsule Networks or the gating network of Mixture of Experts) are the custom layer scenarios where initialization is most prone to problems.