| University Libraries
Social media data is often tricky to access and data availability depends on the time period and platform(s) you need to research.
Before conducting research using data from social media sources, you must read the platform’s terms of service, which is a pseudo-legal agreement that determines how data can be acquired, used, stored, and shared. Many platforms have restrictions on the automated gathering of posts and do not allow web scraping.
You also have to consider the ethics of such research. Legally, researchers do not need to get informed consent because users of social media platforms nominally agree to let third parties use their data when they agree to the platform’s terms of service. However researchers should consider what the users’ expectations of privacy were when they posted content and if the content includes identifying or sensitive information.
In some cases it might be acceptable to manually retrieve the data you need, but not when you will be publishing your research. Keep in mind that this would not constitute a scientific or legitimate sampling.
Remember that social media users are only a small subset of the larger population, and that what is trending on social media is not necessarily representative of what is happening in contemporary society at large. Social media platforms are spaces where people with extreme views can share and propagate those views. Many platforms no longer provide fact checking or place any kinds of restrictions or warnings on sharing misinformation or using hate speech. Bots comprise a large number of "users" for some of these platforms.
If you do not need to create a dataset of social media data, consider using ProQuest Congressional to view social media posts from members of Congress and federal agencies. You cannot download this data in bulk and you cannot scrape the ProQuest interface.
