I think it's called "Alpha City" and here is the version I'm familiar with:
 Have you heard of the city where the Jewels started it all?
   And the name (and the name) of the city is A Phi A, is A Phi A
     Have you heard of the city where the streets are paved with gold?
   And the name (and the name) of the city is A Phi A, is A Phi A
     Have you heard of the city where knowledge is first of all?
   And the name (and the name) of the city is A Phi A, is A Phi A
     We will go to the city where we pledge our hearts and lives
   And the name (and the name) of the city is A Phi A, is A Phi A