{"id":9423,"date":"2023-05-19T08:57:22","date_gmt":"2023-05-19T01:57:22","guid":{"rendered":"https:\/\/bap-software.net\/?post_type=products&p=9423"},"modified":"2024-01-30T16:34:35","modified_gmt":"2024-01-30T09:34:35","slug":"using-nlp-to-discover-hot-topics-on-social-network","status":"publish","type":"products","link":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/","title":{"rendered":"Using NLP to discover hot topics on social network"},"content":{"rendered":"

<\/p>\n

Problem:<\/strong><\/h2>\n

\"Case
\nThe data on social platform are growing everyday.<\/p>\n

How can we use\u00a0such data\u00a0to discover \u201cWhat is\u00a0happening\u201d on Facebook or Twitter everyday or even every hour?<\/p>\n

We can use the topic modeling for this problem:<\/p>\n

– INPUT: A dataset of Facebook\u2019s posts of the most popular fanpages in Vietnam at a specific time.<\/p>\n

– OUTPUT: A set of top hottest topics that are the most popular on Vietnamese Facebook at that time and their keywords.<\/p>\n

Solution:<\/strong><\/h2>\n

\"Solution<\/p>\n

For this problem, we use the LDA Topic Modeling Technique to solve the challenge.<\/p>\n

LDA is a probability model that find the pattern topic distribution in a corpus (a set of documents).<\/p>\n

Result:<\/strong><\/h2>\n

In October 2019, we discovered these are the hottest topics that Vietnamese Facebook-er were talking about the most:<\/p>\n

\"case<\/p>\n

We also can present the fanpages by vectorizing them, and compare them to look for the similarities:<\/p>\n

\"case<\/p>\n

Here is an comparison between pages base on their content in Oct-2019. The more blue a square is, the more similar two fanpages are:<\/p>\n

\"case<\/p>\n

Oppoturnity:<\/strong><\/h2>\n

With a proper crawler, an improved Topic Modeling technique, we can track the hot topics on Facebook or any social network in every hour or even every second.<\/p>","protected":false},"featured_media":13507,"template":"","product":[65],"cs_tag":[10189,10190],"class_list":["post-9423","products","type-products","status-publish","has-post-thumbnail","hentry","product-ai","cs_tag-ai","cs_tag-ai-technology"],"acf":[],"yoast_head":"\n(English) Using NLP to discover hot topics on social network<\/title>\n<meta name=\"description\" content=\"(English) For this problem, we use the LDA Topic Modeling Technique to solve the challenge.LDA is a probability model that find the pattern topic distribution in a...\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Using NLP to discover hot topics on social network\" \/>\n<meta property=\"og:description\" content=\"(English) For this problem, we use the LDA Topic Modeling Technique to solve the challenge.LDA is a probability model that find the pattern topic distribution in a...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/\" \/>\n<meta property=\"og:site_name\" content=\"(\u65e5\u672c\u8a9e) \u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u958b\u767a-\u30aa\u30d5\u30b7\u30e7\u30a2\u30b5\u30fc\u30d3\u30b9\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bap32\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-30T09:34:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cdn.bap-software.net\/2023\/05\/30233421\/ver-hot-topics-on-social-network-min.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@bapsoftware\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/\",\"url\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/\",\"name\":\"(English) Using NLP to discover hot topics on social network\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cdn.bap-software.net\\\/2023\\\/05\\\/30233421\\\/ver-hot-topics-on-social-network-min.webp\",\"datePublished\":\"2023-05-19T01:57:22+00:00\",\"dateModified\":\"2024-01-30T09:34:35+00:00\",\"description\":\"(English) For this problem, we use the LDA Topic Modeling Technique to solve the challenge.LDA is a probability model that find the pattern topic distribution in a...\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/#breadcrumb\"},\"inLanguage\":\"kr\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[[\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/\"]]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"kr\",\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cdn.bap-software.net\\\/2023\\\/05\\\/30233421\\\/ver-hot-topics-on-social-network-min.webp\",\"contentUrl\":\"https:\\\/\\\/cdn.bap-software.net\\\/2023\\\/05\\\/30233421\\\/ver-hot-topics-on-social-network-min.webp\",\"width\":1024,\"height\":1024,\"caption\":\"Using NLP to discover hot topics on social network\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/using-nlp-to-discover-hot-topics-on-social-network\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Study\",\"item\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/case-study\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Using NLP to discover hot topics on social network\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/#website\",\"url\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/\",\"name\":\"(\u65e5\u672c\u8a9e) \u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u958b\u767a-\u30aa\u30d5\u30b7\u30e7\u30a2\u30b5\u30fc\u30d3\u30b9\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/bap-software.net\\\/kr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"kr\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"(English) Using NLP to discover hot topics on social network","description":"(English) For this problem, we use the LDA Topic Modeling Technique to solve the challenge.LDA is a probability model that find the pattern topic distribution in a...","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/","og_locale":"en_US","og_type":"article","og_title":"Using NLP to discover hot topics on social network","og_description":"(English) For this problem, we use the LDA Topic Modeling Technique to solve the challenge.LDA is a probability model that find the pattern topic distribution in a...","og_url":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/","og_site_name":"(\u65e5\u672c\u8a9e) \u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u958b\u767a-\u30aa\u30d5\u30b7\u30e7\u30a2\u30b5\u30fc\u30d3\u30b9","article_publisher":"https:\/\/www.facebook.com\/bap32","article_modified_time":"2024-01-30T09:34:35+00:00","og_image":[{"width":1024,"height":1024,"url":"https:\/\/cdn.bap-software.net\/2023\/05\/30233421\/ver-hot-topics-on-social-network-min.webp","type":"image\/webp"}],"twitter_card":"summary_large_image","twitter_site":"@bapsoftware","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/","url":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/","name":"(English) Using NLP to discover hot topics on social network","isPartOf":{"@id":"https:\/\/bap-software.net\/kr\/#website"},"primaryImageOfPage":{"@id":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/#primaryimage"},"image":{"@id":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/#primaryimage"},"thumbnailUrl":"https:\/\/cdn.bap-software.net\/2023\/05\/30233421\/ver-hot-topics-on-social-network-min.webp","datePublished":"2023-05-19T01:57:22+00:00","dateModified":"2024-01-30T09:34:35+00:00","description":"(English) For this problem, we use the LDA Topic Modeling Technique to solve the challenge.LDA is a probability model that find the pattern topic distribution in a...","breadcrumb":{"@id":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/#breadcrumb"},"inLanguage":"kr","potentialAction":[{"@type":"ReadAction","target":[["https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/"]]}]},{"@type":"ImageObject","inLanguage":"kr","@id":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/#primaryimage","url":"https:\/\/cdn.bap-software.net\/2023\/05\/30233421\/ver-hot-topics-on-social-network-min.webp","contentUrl":"https:\/\/cdn.bap-software.net\/2023\/05\/30233421\/ver-hot-topics-on-social-network-min.webp","width":1024,"height":1024,"caption":"Using NLP to discover hot topics on social network"},{"@type":"BreadcrumbList","@id":"https:\/\/bap-software.net\/kr\/case-study\/using-nlp-to-discover-hot-topics-on-social-network\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/bap-software.net\/kr\/"},{"@type":"ListItem","position":2,"name":"Case Study","item":"https:\/\/bap-software.net\/kr\/case-study\/"},{"@type":"ListItem","position":3,"name":"Using NLP to discover hot topics on social network"}]},{"@type":"WebSite","@id":"https:\/\/bap-software.net\/kr\/#website","url":"https:\/\/bap-software.net\/kr\/","name":"(\u65e5\u672c\u8a9e) \u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u958b\u767a-\u30aa\u30d5\u30b7\u30e7\u30a2\u30b5\u30fc\u30d3\u30b9","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/bap-software.net\/kr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"kr"}]}},"_links":{"self":[{"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/products\/9423","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/products"}],"about":[{"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/types\/products"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/media\/13507"}],"wp:attachment":[{"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/media?parent=9423"}],"wp:term":[{"taxonomy":"product","embeddable":true,"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/product?post=9423"},{"taxonomy":"cs_tag","embeddable":true,"href":"https:\/\/bap-software.net\/kr\/wp-json\/wp\/v2\/cs_tag?post=9423"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}