The Public Papers of the Presidents are the public writings, addresses and remarks published in the Federal Register. The library has print copies and you can find online copies for:
Obama, Barack H.
Bush, George W.
Clinton, William J.
Bush, George H. W.