wehub-resource-sync
15 lines
714 B
Plaintext
15 lines
714 B
Plaintext
---
|
|
id: cheerio-crawler
|
|
title: Cheerio crawler
|
|
---
|
|
|
|
import RunnableCodeBlock from '@site/src/components/RunnableCodeBlock';
|
|
import ApiLink from '@site/src/components/ApiLink';
|
|
import CheerioCrawlerSource from '!!raw-loader!roa-loader!./cheerio_crawler.ts';
|
|
|
|
This example demonstrates how to use <ApiLink to="cheerio-crawler/class/CheerioCrawler">`CheerioCrawler`</ApiLink> to crawl a list of URLs from an external file, load each URL using a plain HTTP request, parse the HTML using the [Cheerio library](https://www.npmjs.com/package/cheerio) and extract some data from it: the page title and all `h1` tags.
|
|
|
|
<RunnableCodeBlock className="language-js" type="cheerio">
|
|
{CheerioCrawlerSource}
|
|
</RunnableCodeBlock>
|