The Velocity server is a pretty small download at under 3MB so it wouldn't hurt to try it out, even if you're on a slow link.
The source code to use Velocity looks a little like this:
CacheFactory myCacheFactory = new CacheFactory();
Cache myDefaultCache = myCacheFactory.GetCache("default");
string retrieved = myDefaultCache.Get("key1") as string;
There's more source code available for using cache regions, but you don't really need it to get started.