41 lines
953 B
Markdown
41 lines
953 B
Markdown
# Scrappers
|
|
|
|
Two scrappers:
|
|
* The 4chancrape one dls all images from a thread in best res
|
|
* The other one simply looks for "img" in any given page and downloads images
|
|
* 4chanthreadfinder looks for a keyword in thread names, and dls all images from relevant threads
|
|
|
|
## 4chanscrape, imgscrape
|
|
Install depedencies:
|
|
|
|
```
|
|
python3 -m pip install beautifulsoup4 mechanicalsoup wget --user
|
|
```
|
|
|
|
Use:
|
|
|
|
```
|
|
./4chanscrape.py -u https://boards.4channel.org/c/thread/3846676/gunsmith-cats-thread -f ./downloads
|
|
```
|
|
|
|
* -u : URL of the page
|
|
* -f : folder where you want to download all pictures
|
|
|
|
## 4chanthreadfinder
|
|
Install depedencies:
|
|
|
|
```
|
|
python3 -m pip install beautifulsoup4 mechanicalsoup wget --user
|
|
```
|
|
|
|
Use:
|
|
|
|
```
|
|
./4chanthreadfinder.py -u https://boards.4chan.org/b/ -f ./downloads/thread -k 'ylyl thread'
|
|
```
|
|
|
|
* -u : URL of the page
|
|
* -f : folder where you want to download all pictures
|
|
* -k : keyword or keyphrase to search (better use a single word !)
|
|
|