Top News: Real Time News Scraping and Recommendation System

JUN 2017 - SEP 2017

PROJECT DESCRIPTION

  • Implemented a data pipeline which monitors, scrapes and dedupes latest news
  • (MongoDB, Redis, RabbitMQ, TF-IDF)

  • Built a single-page web application for users to browse news
  • (React, Node.js, RPC, SOA, JWT)

  • Implemented a click event log processor which collects users’ click logs, then updates a news preference model for each user
  • (NLP)

  • Designed and built an offline training pipeline for news topic modeling
  • (Tensorflow, DNN, NLP)

  • Deployed an online classifying service for news topic modeling using the trained model
top news