This is actually a text bug. Avatars CAN relocate on their own accord, they just cannot be relocated by other runes. In the case of Grimlic's Portal, it gains the ability Portal, which allows it to relocate. But you cannot use Swap on an Avatar. Will update the text to clarify this.