wehub-resource-sync
247153575d
Tests / tests (map[TOXENV:py310], macos-latest, 3.10) (push) Has been cancelled
Tests / tests (map[TOXENV:py311], macos-latest, 3.11) (push) Has been cancelled
Tests / tests (map[TOXENV:py312], macos-latest, 3.12) (push) Has been cancelled
Tests / tests (map[TOXENV:py313], macos-latest, 3.13) (push) Has been cancelled
30 lines
1013 B
Markdown
30 lines
1013 B
Markdown
# Command Line Interface
|
|
|
|
Since v0.3, Scrapling includes a powerful command-line interface that provides three main capabilities:
|
|
|
|
1. **Interactive Shell**: An interactive Web Scraping shell based on IPython that provides many shortcuts and useful tools
|
|
2. **Extract Commands**: Scrape websites from the terminal without any programming
|
|
3. **Utility Commands**: Installation and management tools
|
|
|
|
```bash
|
|
# Launch interactive shell
|
|
scrapling shell
|
|
|
|
# Convert the content of a page to markdown and save it to a file
|
|
scrapling extract get "https://example.com" content.md
|
|
|
|
# Get help for any command
|
|
scrapling --help
|
|
scrapling extract --help
|
|
```
|
|
|
|
## Requirements
|
|
This section requires you to install the extra `shell` dependency group, like the following:
|
|
```bash
|
|
pip install "scrapling[shell]"
|
|
```
|
|
and the installation of the fetchers' dependencies with the following command
|
|
```bash
|
|
scrapling install
|
|
```
|
|
This downloads all browsers, along with their system dependencies and fingerprint manipulation dependencies. |