A button will appear on the "Content which failed to download" page which should allow you to download all the missing Pixiv content.
|6 days ago|
|images||3 weeks ago|
|templates||6 days ago|
|webInterface||6 days ago|
|webInterfaceNoAuth||7 months ago|
|.clang-format||8 months ago|
|.gitignore||3 weeks ago|
|CreateDatabase.py||9 months ago|
|Generate_Certificates.sh||1 year ago|
|LICENSE.txt||3 months ago|
|LikedSavedDatabase.py||6 days ago|
|LikedSavedDownloaderServer.py||6 days ago|
|PasswordManager.py||8 months ago|
|ReadMe.org||3 weeks ago|
|crcUtils.py||2 years ago|
|imageSaver.py||6 days ago|
|imgurDownloader.py||1 month ago|
|logger.py||2 years ago|
|pixivScraper.py||3 weeks ago|
|redditLikedSavedImageDownloader.sublime-project||2 years ago|
|redditScraper.py||3 months ago|
|redditUserImageScraper.py||3 weeks ago|
|settings.py||3 weeks ago|
|settings_template.txt||8 months ago|
|submission.py||6 days ago|
|tumblrScraper.py||2 years ago|
|utilities.py||1 year ago|
|videoDownloader.py||1 month ago|
Use this awesome tool to download
…which you've marked as Liked, Hearted, or Saved from
…to disk! You can then browse the results.
Check the Releases page for a ready-to-use version of Content Collector. If you find a release for your system that works, you can skip straight to the Usage section.
git clone https://github.com/makuto/Liked-Saved-Image-Downloader
The following dependencies are required:
pip install praw pytumblr ImgurPython jsonpickle tornado youtube-dl git+https://github.com/ankeshanand/py-gfycat@master git+https://github.com/upbit/pixivpy
You'll want to use Python 3, which for your environment may require you to specify
pip3 instead of just
If you want to require the user to login before they can interact with the server, you must install passlib:
pip install passlib bcrypt argon2_cffi
cd Liked-Saved-Image-Downloader/ ./Generate_Certificates.sh
This step is only required if you want to use SSL, which ensures you have an encrypted connection to the server. You can disable this by opening
LikedSavedDownloaderServer.py and setting
useSSL = False.
Open localhost:8888 in any web browser.
If your web browser complains about the certificate, you may have to click
Advanced and add the certificate as trustworthy, because you've signed the certificate and trust yourself :).
(Explanation: this certificate isn't trusted by your browser because you created it. It will still protect your traffic from people snooping on your LAN).
If you want to get rid of this, you'll need to get a signing authority like
LetsEncrypt to generate your certificate, and host the server under a proper domain.
When first running the server, you will be prompted to set a password.
If you forget your password, simply delete passwords.txt.
The home page provides access to all server features:
Use Settings to configure the script:
Make sure to click "Save Settings" before closing the page.
You don't have to fill in every field, only the accounts you want.
Go to the Download Content page and click "Download new content":
Wait until the downloader finishes (it will say "Finished" at the bottom of the page). While the downloader is running, the "Download new content" button will disappear.
Enjoy! Use Browse Content to jump to random content you've downloaded, or browse your output directory:
The browser should scale nicely to work on both mobile and desktop.
The script requires login before running the script, changing settings, or browsing downloaded content.
If you host Content Collector on the internet, you should rely on a more robust authentication scheme (e.g. use a reverse proxy which won't proxy requests to Content Collector until you have authenticated with the proxy server). Content Collector was designed for LAN use.
Note that all login cookies will be invalidated each time you restart the server. If you don't restart the server, your browser should remember login indefinitely.
The web interface will automatically prompt for a new password when first starting up.
You can also use
PasswordManager.py to generate a file
passwords.txt with your hashed (and salted) passwords:
python3 PasswordManager.py "Your Password Here"
You can create multiple valid passwords, if desired. There are no separate accounts, however.
If you want to reset all passwords, simply delete
LikedSavedDownloaderServer.py and find
enable_authentication. Set it equal to
False. You must restart the server for this to take effect.
This is deprecated. You should use the web server to configure and run the script instead.
settings_template.txt into a new file called
Fill in your username and password
False if you are sure you want to do this
Run the script:
Wait for a while
Check your output directory (the default is
output relative to where you ran the script) for all your images!
If you want more images, set
Tumblr_Total_Requests to a higher value. The maximum is 1000. Unfortunately, reddit does not allow you to get more than 1000 submissions of a single type (1000 liked, 1000 saved).
Not actually getting images downloaded, but seeing the console say it downloaded images? Make sure
settings.txt has several additional features. Read the comments to know how to use them.
On OSX, running the downloader from the Content Collector server may cause this error:
Output: output objc: +[__NSPlaceholderDate initialize] may have been in progress in another thread when fork() was called.
This is a problem with Python and OSX's security model clashing. See this issue for an explanation.
To work around it, you need to first run
…before running the Content Collector server in that same terminal.
Or add the bash profile suggested in this answer.
Feel free to create Issues on this repo if you need help. I'm friendly so don't be shy.