Ubuntu Package Search + Package Data Processing Pipeline

The project is a two parter:

• Data processing pipeline for ubuntu packages data
• Information Retrieval System for ubuntu packages

Project Structure

• docs: Reports for FEUP-M.EIC-PRI course (Faculty of Engineering of University of Porto)
• graphical-interface: web app for searching ubuntu packages
• pipeline: scripts and makefile for the collection and processing of the information used in the system
• search-system: underlying SOLR system configurations and scripts

Authors

Name	E-Mail
Francisco Pinto de Oliveira	up201907361@edu.fe.up.pt
Marcelo Henriques Couto	up201906086@edu.fe.up.pt
José Pedro Abreu Silva	up201904775@edu.fe.up.pt

Usage

Pipeline

To run the pipeline, you will need Make. Run:

make

Search System

Run the startup script in /search-system:

./startup.sh

Install the dependencies of the backend (/backend directory) and run it (you will need node and npm):

npm i
npm run start

Install the dependencies of the frontend (/frontend directory) and run it (you will need node and npm):

npm i
npm run start

Evaluation Scripts

To run the evaluation scripts (evaluate the performance of the search system by generating metrics and graphs):

cd search-system/evaluation
python main.py