All chapters should have an alumni/alumnae advisory panel/board.
I serve on the board for my collegiate chapter as both the scholarship and music advisor. Come December if no one has stepped up, I've offered to advise the panhellenic delegate and editor/historian offices in addition to what I already advise.
If you are unsure of something your Fraternity HQ should have a manual for each advisor telling you of your responsibilities, the responsibilities of the office you advise, and policies pertaining to that office.
Remember as an advisor your job is to advise...........answer questions, give advice if you see something beign done or not being done, and sign off on the paperwork, not do the job for the officer you are advising.