Just as you needed your Secretary of State's permission to open your company, you'll need its permission to close (dissolve) it. This is done by what's sometimes called a Certificate of Dissolution. However, before you reach that point, you need to be sure that there are no outstanding taxes or tax returns that need to be filed, and that you're not leaving any creditors in the lurch.
It's not a difficult process, but it will involve some paperwork. Speak to your attorney and accountant to confirm the documents you'll need to file in your state.