# Scrappers

Two scrappers:
* The 4chancrape one dls all images from a thread in best res
* The other one simply looks for "img" in any given page and downloads images
* 4chanthreadfinder looks for a keyword in thread names, and dls all images from relevant threads

## 4chanscrape, imgscrape
Install depedencies:

```
python3 -m pip install beautifulsoup4 mechanicalsoup wget --user
```

Use:

```
./4chanscrape.py -u https://boards.4channel.org/c/thread/3846676/gunsmith-cats-thread -f ./downloads
```

* -u : URL of the page
* -f : folder where you want to download all pictures

## 4chanthreadfinder
Install depedencies:

```
python3 -m pip install beautifulsoup4 mechanicalsoup wget --user
```

Use (oneshot):

```
./4chanthreadfinder.py -u https://boards.4chan.org/b/ -f ./downloads/thread -k 'ylyl thread'
```

* -u : URL of the page
* -f : folder where you want to download all pictures
* -k : keyword or keyphrase to search (better use a single word !)

Use (constant, multi-threaded):
```
./4chanthreadfinder.py -u https://boards.4chan.org/b/ -f ./downloads/threads -k 'thread' -c -t 3
```
* -u : URL of the page
* -f : folder where you want to download all pictures
* -k : keyword or keyphrase to search (better use a single word !)
* -c : constant : enables constant downloading

##Todo
* Filter by filetype
* Make a pretty website with some keywords running in the bg, making for some nice public folders (wallpapers...)