How do you write programs in C# with a text editor?

I enjoy programming and I recently started learning C#. I read that you can program with a text editor and convert a .cs file to an exe with a batch file of some sort. I have Visual C# 2010, but it would be fun to be able to write programs on any computer without having to download any big programs. Thanks.