George
If you have the lights with gold colored bezels (surrounds), the gold bezel will twist off allowing access to the bulb. If they don't have a bezel they most likely pull down as they are held in place by springs on each side of the light.
It is not a fuse since 1 of the lights works and the bedroom ceiling, aisle, and reading lights are should all be on a single 12v, 15 amp circuit.
Steve