Title: Scrap academic staff profile from static site
Site: https://cs.usm.my/index.php/about/our-people/facultycs-member
Tech Stack: BeautifulSoup
Purpose: To 🔎 potential FYP supervisors easily using filter function.
Data file: https://bit.ly/cslecturer
| column_name | description |
|---|---|
| name | lecturer's name + title |
| lecturer's usm email | |
| title | lecturer's title |
| research cluster | 3 clusters available: Data To Knowledge, Service Computing, Enabling Technologies & Infrastructures |
| specialization | describe one's research expertise |
| interest | describe one's research interest |
| qualification | describe one's education background |
| source_url | directory to official site |
- Open file *You may download the file as xlsx
- Create filter views
- Select 'Filter by condition'
- Key in desired value E.g. security, software engineering
Feel free to create pull request if you are interested to enhance the data quality. This repo is for educational purposes only. 🤗🤗
Future works: Will demo web scraping for dynamic JS site.