How can I preview my extension in my channel? Can I?

if you are testing in the dashboard the dashboard/config boxes will work without being live.

if you mean to test the frontend code for the extension that shows over the video, on Twitch you HAVE to be live. Otherwise you need to create a view in the rig

Then you will not need to be live to look at your extension.