You need to also have some sort of access the matrix yes. This is typically done by using a commlik. But riggers often use a RCC instead. And deckers use a cyberdeck. And technomancers have a deviceless living persona.
But as long as you are accessing the matrix and have DNI (which you get by wearing trodes or by implanting a datajack, control rig, commlink or cyberdeck) you will experience AR directly in your mind. No other devices such as AR gloves, image links, earbuds etc are needed. Just keep your commlink with you at all times and you will be good to go :-)
To experience VR (and BTL) you also need a sim module. Commlinks does not come with one default (unless they are implanted), but they can be modded with one. RCC also don't come with a sim module, but lucky for riggers the control rig implant do. Cyberdecks come automatically with a sim module (it is even modded for hot-sim by default, this is otherwise an illegal mod for your commlink).
If you have a both DNI and a sim module then you can also even experience smell and taste in AR, not just seeing, hearing and feeling.