My favorite place to find records: garage sales and estate sales.
They're generally cheaper than eBay or a record store where individual LPs have been appraised for market value. I will say homeowners and estate sale companies started price gouging in recent years but I still have had success scoring records that would normally go for $15+ for $5 and under, including hip-hop LPs.
Of course, if you live in a small town, this isn't going to work for you, plus you need to come early. Otherwise, the dealers will get all the goods.
I like buying records from wrekka stos, too, I'm just picky about who I give my money to.
As for record players, many local record stores sell older, used models for $200 and under. This is a good way to get a good quality record player for a much lower price.
If you want to buy new, Audio Technia makes a few brand new belt and direct drive models for about $200.