Beginner: Seeing other pc's on a LAN

Apologies for the basicness of this question. I use DAVE to connect my pc and mac on a LAN through a Linksys router, and it works out fine.

But now I am trying to network 2 pc's on a LAN using a Linksys router. Alas I don't know how to do this.

Both the pc's can access the the Internet through the router, but how do I make the pc's see each other?

I guess what I'm trying to say is this is the simplest network possible: 2 pc's connected to the internet and each other via a Linksys router. How do I get each computer to "see" the other?

Is there some magical setting somewhere? Something to do with DHCP?

Are you running DHCP? or do the PC's have static IP addresses?

If they have Static IP addresses, do they have the same network address? (Ex. 192.168.0 would be the network address and 192.168.0.5 would be the PC's address) They both have to be on the same network address.

The other question would be are they on the same workgroup or domain?

Hope this helps?

Norman