When I go to Domains -> Manage Domains and click DNS, there's not much there, probably because my domain is still registered elsewhere. I get the big scary "Advanced users only" message, and it lists the Dreamhost nameservers down at the bottom, but no actual DNS info in between.
The wiki page is very helpful. I managed to config a subdomain. Then when I go edit the subdomain DNS, I get the ip address I can use to update my DNS.
Thanks a bunch!