I keep mine separate and don't factor it into my net worth or allocation.
There's a few reasons for this. One is I've compartmentalized it emotionally as already 'lost'. So I don't bad if my gambles fail horribly. If they do well, I'll transfer some of that money out into our 'real investments' which get counted in our net worth. Second, is that the fraction of money reserved for gambling like this is ~.25% of our net worth, so it's almost immaterial.
My risky gambling allocation is primarily crypto-currencies. I also pull this from the same pool of money I use for ACTUAL gambling, (i.e. craps and blackjack).