Design an information and analytical system for selecting vacancies
Its a homework assignment, not a commercial story.
There is a wide variety of areas of work of IT specialists. Each direction implies the mastery of a certain technology stack by a specialist, and the requirements may differ significantly from one employer to another. It is difficult for a young specialist to understand and choose the most promising technologies for his development. Teachers and heads of educational programs need to monitor the relevance of the technologies taught. Students need to build a learning trajectory taking into account the relevance of certain technologies.
The task is to help students and young professionals, as well as teachers
determine the technology stack is necessary for study in one direction or another
based on the existing technology stack, select vacancies
identify the most sought-after technologies in the subject area (e.g. databases)
Decision
develop a technology and structure for collecting data from job sites such as hh.ru
develop a database to store the collected data
develop a technology for pre-processing data for loading into the database
choose methods of data analysis and presentation
prepare data marts
present the client part
Problems in solving the problem
no technology dictionary
there is no unity in the names of technologies and specialties used by employers
How to solve the problem
the site hh.ru has a well-documented API https://dev.hh.ru/
there are examples of working with the hh API in python
https://office-menu.ru/python/96-api-hh
https://habr.com/ru/post/464823/
it is recommended to use PosgreSQL, MySQL or one of the NoSQL databases as a database
data marts are recommended to be made on the basis of Python, but other solutions are also welcome
Id like to see Python, PostgreSQL, Java (Spring Boot is even thymeleaf of template engines, but also not particularly important), but if there is something else, its okay.
The price is negotiable.
24.05.2022 20:40