Python/ImageScrapper
Archived
2
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

threadfinder

Browse Source
This commit is contained in:
Justine
2021-02-07 22:46:38 +01:00
parent 6d08071c6c
commit bd16dc7a6e
3 changed files with 166 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

22
README.md
View File

@ -1,9 +1,11 @@
# Scrappers
Two scrappers:
* The 4chan one dls all images from a thread in best res
* The 4chancrape one dls all images from a thread in best res
* The other one simply looks for "img" in any given page and downloads images
* 4chanthreadfinder looks for a keyword in thread names, and dls all images from relevant threads
## 4chanscrape, imgscrape
Install depedencies:
```
@ -18,3 +20,21 @@ Use:
* -u : URL of the page
* -f : folder where you want to download all pictures
## 4chanthreadfinder
Install depedencies:
```
python3 -m pip install beautifulsoup4 mechanicalsoup wget --user
```
Use:
```
./4chanthreadfinder.py -u https://boards.4chan.org/b/ -f ./downloads/thread -k 'ylyl thread'
```
* -u : URL of the page
* -f : folder where you want to download all pictures
* -k : keyword or keyphrase to search (better use a single word !)