Graphite molecules are flat groups of carbon atoms that are stacked in layers. The layers slide against each other and allow the lead to slide off the pencil point and onto the paper. When you erase with a rubber eraser, the graphite in the lead sticks to the rubber better than it does to the paper.
