Data.gov.au - Is hosted by the Australian Government. At present it contains over 1000 datasets, including datasets on Culture. Contains a bunch of interesting apps and links to resources like GIS and Datawrangler.
Datacatalogs.org - Is a portal to open Datasets from around the world. API compatible. Contains a few datasets under the banner of 'news'
Eurostat - Business and demographic statistics from the Eurozone. Also contains specialist datasets like information society.
Statista - A wonderful data portal with an easy to use search interface. Try searching for anything you like - 'internet shopping', 'US Elections', 'social media' and see what it can do!
World Bank Data Catalog - A wealth of datasets from all parts of the globe. Contains World Development Indicators, World Bank Finances, Health, Education Stats and specialist sets like Information and Communication Technologies. Largely API compatible.