Neural Networks For Periodic Functions
When ReLU’s extrapolation capabilities are not enough
Published in
8 min readJan 17, 2024
Neural networks are known to be great approximators for any function — at least whenever we don’t move too far away from our dataset. Let us see what that means. Here is some data: