Week 09

Apis + Selenium

Lectures Notes:

• APIs html – Jupyter Notebook

• Selenium html – Jupyter Notebook

Slides

• Acquiring data on the Web: APIs and Selenium

Readings

APIs

• Nice overview about APIs from Chris Bail here. (it is in R, so pay more attention to the concepts)

Selenium

• Tutorial Webscrapping using Selenium

• Set up your selenium environment: https://selenium-python.readthedocs.io/installation.html

• Web Driver Manager library in Python: https://pypi.org/project/webdriver-manager/

• Locating elements in Selenium: https://selenium-python.readthedocs.io/locating-elements.html

Applied Research

• Trielli, Daniel, and Nicholas Diakopoulos. “Search as news curator: The role of Google in shaping attention to news information.” In Proceedings of the 2019 CHI Conference on human factors in computing systems, pp. 1-15. 2019.

• Haroon, Muhammad, Anshuman Chhabra, Xin Liu, Prasant Mohapatra, Zubair Shafiq, and Magdalena Wojcieszak. “YouTube, the great radicalizer? Auditing and mitigating ideological biases in YouTube recommendations.” arXiv preprint arXiv:2203.10666 (2022).