179 lines
9.9 KiB
Markdown
179 lines
9.9 KiB
Markdown
# SafariBooks
|
||
Download and generate *EPUB* of your favorite books from [*Safari Books Online*](https://www.safaribooksonline.com) library.
|
||
I'm not responsible for the use of this program, this is only for *personal* and *educational* purpose.
|
||
Before any usage please read the *O'Reilly*'s [Terms of Service](https://learning.oreilly.com/terms/).
|
||
|
||
<a href='https://ko-fi.com/Y8Y0MPEGU' target='_blank'><img height='80' style='border:0px;height:60px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com'/></a>
|
||
|
||
## ✨✨ *Attention needed* ✨✨
|
||
- This project is no longer actively maintained.
|
||
- *Login through `safaribooks` no longer works due to changes in ORLY APIs.*
|
||
- *The program needs a major refactor to include new features and integrate new APIs.*
|
||
- **However... it still work for downloading books.**
|
||
(Use SSO hack: log in via browser, then copy cookies into `cookies.json`, see below and issues. Love ❤️)
|
||
|
||
---
|
||
|
||
## Overview:
|
||
* [Requirements & Setup](#requirements--setup)
|
||
* [Usage](#usage)
|
||
* [Single Sign-On (SSO), Company, University Login](https://github.com/lorenzodifuccia/safaribooks/issues/150#issuecomment-555423085)
|
||
* [Calibre EPUB conversion](https://github.com/lorenzodifuccia/safaribooks#calibre-epub-conversion)
|
||
* [Example: Download *Test-Driven Development with Python, 2nd Edition*](#download-test-driven-development-with-python-2nd-edition)
|
||
* [Example: Use or not the `--kindle` option](#use-or-not-the---kindle-option)
|
||
|
||
## Requirements & Setup:
|
||
First of all, it requires `python3` and `pip3` or `pipenv` to be installed.
|
||
```shell
|
||
$ git clone https://github.com/lorenzodifuccia/safaribooks.git
|
||
Cloning into 'safaribooks'...
|
||
|
||
$ cd safaribooks/
|
||
$ pip3 install -r requirements.txt
|
||
|
||
OR
|
||
|
||
$ pipenv install && pipenv shell
|
||
```
|
||
|
||
The program depends of only two **Python _3_** modules:
|
||
```python3
|
||
lxml>=4.1.1
|
||
requests>=2.20.0
|
||
```
|
||
|
||
## Usage:
|
||
It's really simple to use, just choose a book from the library and replace in the following command:
|
||
* X-es with its ID,
|
||
* `email:password` with your own.
|
||
|
||
```shell
|
||
$ python3 safaribooks.py --cred "account_mail@mail.com:password01" XXXXXXXXXXXXX
|
||
```
|
||
|
||
The ID is the digits that you find in the URL of the book description page:
|
||
`https://www.safaribooksonline.com/library/view/book-name/XXXXXXXXXXXXX/`
|
||
Like: `https://www.safaribooksonline.com/library/view/test-driven-development-with/9781491958698/`
|
||
|
||
#### Program options:
|
||
```shell
|
||
$ python3 safaribooks.py --help
|
||
usage: safaribooks.py [--cred <EMAIL:PASS> | --login] [--no-cookies]
|
||
[--kindle] [--preserve-log] [--help]
|
||
<BOOK ID>
|
||
|
||
Download and generate an EPUB of your favorite books from Safari Books Online.
|
||
|
||
positional arguments:
|
||
<BOOK ID> Book digits ID that you want to download. You can find
|
||
it in the URL (X-es):
|
||
`https://learning.oreilly.com/library/view/book-
|
||
name/XXXXXXXXXXXXX/`
|
||
|
||
optional arguments:
|
||
--cred <EMAIL:PASS> Credentials used to perform the auth login on Safari
|
||
Books Online. Es. ` --cred
|
||
"account_mail@mail.com:password01" `.
|
||
--login Prompt for credentials used to perform the auth login
|
||
on Safari Books Online.
|
||
--no-cookies Prevent your session data to be saved into
|
||
`cookies.json` file.
|
||
--kindle Add some CSS rules that block overflow on `table` and
|
||
`pre` elements. Use this option if you're going to
|
||
export the EPUB to E-Readers like Amazon Kindle.
|
||
--preserve-log Leave the `info_XXXXXXXXXXXXX.log` file even if there
|
||
isn't any error.
|
||
--help Show this help message.
|
||
```
|
||
|
||
The first time you use the program, you'll have to specify your Safari Books Online account credentials (look [`here`](/../../issues/15) for special character).
|
||
The next times you'll download a book, before session expires, you can omit the credential, because the program save your session cookies in a file called `cookies.json`.
|
||
For **SSO**, please use the `sso_cookies.py` program in order to create the `cookies.json` file from the SSO cookies retrieved by your browser session (please follow [`these steps`](/../../issues/150#issuecomment-555423085)).
|
||
|
||
Pay attention if you use a shared PC, because everyone that has access to your files can steal your session.
|
||
If you don't want to cache the cookies, just use the `--no-cookies` option and provide all time your credential through the `--cred` option or the more safe `--login` one: this will prompt you for credential during the script execution.
|
||
|
||
You can configure proxies by setting on your system the environment variable `HTTPS_PROXY` or using the `USE_PROXY` directive into the script.
|
||
|
||
#### Calibre EPUB conversion
|
||
**Important**: since the script only download HTML pages and create a raw EPUB, many of the CSS and XML/HTML directives are wrong for an E-Reader. To ensure best quality of the output, I suggest you to always convert the `EPUB` obtained by the script to standard-`EPUB` with [Calibre](https://calibre-ebook.com/).
|
||
You can also use the command-line version of Calibre with `ebook-convert`, e.g.:
|
||
```bash
|
||
$ ebook-convert "XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698)/9781491958698.epub" "XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698)/9781491958698_CLEAR.epub"
|
||
```
|
||
After the execution, you can read the `9781491958698_CLEAR.epub` in every E-Reader and delete all other files.
|
||
|
||
The program offers also an option to ensure best compatibilities for who wants to export the `EPUB` to E-Readers like Amazon Kindle: `--kindle`, it blocks overflow on `table` and `pre` elements (see [example](#use-or-not-the---kindle-option)).
|
||
In this case, I suggest you to convert the `EPUB` to `AZW3` with Calibre or to `MOBI`, remember in this case to select `Ignore margins` in the conversion options:
|
||
|
||
|
||
|
||
## Examples:
|
||
* ## Download [Test-Driven Development with Python, 2nd Edition](https://www.safaribooksonline.com/library/view/test-driven-development-with/9781491958698/):
|
||
```shell
|
||
$ python3 safaribooks.py --cred "my_email@gmail.com:MyPassword1!" 9781491958698
|
||
|
||
____ ___ _
|
||
/ __/__ _/ _/__ _____(_)
|
||
_\ \/ _ `/ _/ _ `/ __/ /
|
||
/___/\_,_/_/ \_,_/_/ /_/
|
||
/ _ )___ ___ / /__ ___
|
||
/ _ / _ \/ _ \/ '_/(_-<
|
||
/____/\___/\___/_/\_\/___/
|
||
|
||
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
||
[-] Logging into Safari Books Online...
|
||
[*] Retrieving book info...
|
||
[-] Title: Test-Driven Development with Python, 2nd Edition
|
||
[-] Authors: Harry J.W. Percival
|
||
[-] Identifier: 9781491958698
|
||
[-] ISBN: 9781491958704
|
||
[-] Publishers: O'Reilly Media, Inc.
|
||
[-] Rights: Copyright © O'Reilly Media, Inc.
|
||
[-] Description: By taking you through the development of a real web application
|
||
from beginning to end, the second edition of this hands-on guide demonstrates the
|
||
practical advantages of test-driven development (TDD) with Python. You’ll learn
|
||
how to write and run tests before building each part of your app, and then develop
|
||
the minimum amount of code required to pass those tests. The result? Clean code
|
||
that works.In the process, you’ll learn the basics of Django, Selenium, Git,
|
||
jQuery, and Mock, along with curre...
|
||
[-] Release Date: 2017-08-18
|
||
[-] URL: https://learning.oreilly.com/library/view/test-driven-development-with/9781491958698/
|
||
[*] Retrieving book chapters...
|
||
[*] Output directory:
|
||
/XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition (9781491958698)
|
||
[-] Downloading book contents... (53 chapters)
|
||
[#####################################################################] 100%
|
||
[-] Downloading book CSSs... (2 files)
|
||
[#####################################################################] 100%
|
||
[-] Downloading book images... (142 files)
|
||
[#####################################################################] 100%
|
||
[-] Creating EPUB file...
|
||
[*] Done: /XXXX/safaribooks/Books/Test-Driven Development with Python 2nd Edition
|
||
(9781491958698)/9781491958698.epub
|
||
|
||
If you like it, please * this project on GitHub to make it known:
|
||
https://github.com/lorenzodifuccia/safaribooks
|
||
e don't forget to renew your Safari Books Online subscription:
|
||
https://learning.oreilly.com
|
||
|
||
[!] Bye!!
|
||
```
|
||
The result will be (opening the `EPUB` file with Calibre):
|
||
|
||
|
||
|
||
* ## Use or not the `--kindle` option:
|
||
```bash
|
||
$ python3 safaribooks.py --kindle 9781491958698
|
||
```
|
||
On the right, the book created with `--kindle` option, on the left without (default):
|
||
|
||
|
||
|
||
---
|
||
|
||
## Thanks!!
|
||
For any kind of problem, please don't hesitate to open an issue here on *GitHub*.
|
||
|
||
*Lorenzo Di Fuccia*
|