No Ted, One side will connect to Live on the output side of the switch and the other side of the neon will connect to Neutral.
When the switch is off the Neon will be dark - when the switch is on the neon illuminates to tell you so.
Sometimes people wire the switch back to front (I do it from time to time) and the neon stays on all the time! If you have done this just swap over the in and out cables.
It's a slightly unsafe situation if the neon is on all the time because you can't tell if the equipment taking the power is on or off - everything should work ok though.
Peccavi, December 2008