There are a few things you can do to clean a nut milk bag. First, remove the nuts from the bag. Second, wring out as much of the water as possible. Finally, place the nuts in a bowl and pour the water over them. Let them sit for at least 10 minutes to allow the water to soak in.