jyapayne/worm-scraper
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
141 commits 1 branch 27 tags 2 MiB
Commit graph

120 commits

Author SHA1 Message Date
Domenic Denicola
3e2bc4a447 Fix train station capitalization 2020-10-26 21:58:40 -04:00
Domenic Denicola
5cbbd8a6fb Fix missing space in many instances of "shoulder blade" 2020-10-26 21:58:40 -04:00
Domenic Denicola
b6bce1244d Spot fixes for Ward through Eclipse x.1 2020-10-26 21:58:40 -04:00
Domenic Denicola
e2277751c0 Fix various dash issues 2020-10-26 21:58:40 -04:00
Domenic Denicola
ad2c0b0ca5 Improve conversion speed using a worker pool 2020-10-26 21:58:40 -04:00
Domenic Denicola
6848456bc9 Fix overcapitalizations of "master" 2020-10-26 21:58:40 -04:00
Domenic Denicola
eebd6cb669 Spot fixes for Ward through Shadow 5.12 2020-10-26 21:58:40 -04:00
Domenic Denicola
68eabd0ca0 Fix incorrect over-substitution of "TV" in place of "tv" 
Ward contains several instances of words that contain "tv", which shouldn't get capitalized.
 2020-10-26 21:58:40 -04:00
Domenic Denicola
d4c67d73df Fix uncapitalized sentences 2020-10-26 21:58:40 -04:00
Domenic Denicola
ae5b179d7c Add a nice progress bar for the convert step 2020-10-26 21:58:40 -04:00
Domenic Denicola
51520c11be Add an original-URL HTML comment to each chapter 
This makes it easier for me to figure out how to update substitutions.json.
 2020-10-26 21:58:40 -04:00
Domenic Denicola
e13ca0de74 Remove xmlserializer dependency 
jsdom can be counted on to do that for us, these days, in a more standards-complaint way. A notable change is that void elements get serialized like <br /> instead of <br/>.
 2020-10-26 21:58:40 -04:00
Domenic Denicola
7e9da35803 Spot fixes for Ward through Shadow 5.8 2020-10-17 20:18:24 -04:00
Domenic Denicola
5a6f3e8cfb Fix hyphenation of "able-bodied" 2020-10-17 20:18:12 -04:00
Domenic Denicola
f300159db3 Use en dashes for joint constructions 2020-10-17 20:17:55 -04:00
Domenic Denicola
bb5c652a3d Fix capitalization of "Mom" when used as a name 2020-10-17 20:17:45 -04:00
Domenic Denicola
697f8a76ea Fix the capitalization of "Dad" when used as a name 2020-10-17 20:17:31 -04:00
Domenic Denicola
97228bf88d Fix possessives of more names ending in "s" 
This is almost all about the new names introduced in Ward, plus "Chuckles" was missed in Worm.
 2020-10-17 20:17:10 -04:00
Domenic Denicola
e71da44ca2 Capitalize a couple of "Birdcage" instances 2020-10-17 20:16:58 -04:00
Domenic Denicola
4e59937e19 Fix various erroneous repeated words 2020-10-17 20:16:48 -04:00
Domenic Denicola
84e0d83bd1 Standardize on one capitalization for "patrol block" 2020-10-17 20:16:32 -04:00
Domenic Denicola
26b4cb07af Fix missing spaces after periods 2020-10-17 20:16:17 -04:00
Domenic Denicola
24b01e4292 Fix miscapitalizations of "ReSound" 2020-10-17 20:16:02 -04:00
Domenic Denicola
4091530bb2 Fix some over-italicized periods 2020-10-17 20:15:53 -04:00
Domenic Denicola
cac9a924dc Fix extra non-breaking spaces after periods 2020-10-17 20:15:29 -04:00
Domenic Denicola
eec513bb8d Always capitalize "Cedar Point" and "Hollow Point" 2020-10-17 20:15:14 -04:00
Domenic Denicola
91f02bd029 Fix some hyphens to become em dashes at the beginning of italicized quotes 2020-10-17 20:14:57 -04:00
Domenic Denicola
176d88eea2 Fix over-capitalization of "clairvoyants" in Ward 
The heuristic used to fix up Worm needed tweaking for Ward, where lowercase "clairvoyants" occurs several times.
 2020-10-17 20:14:38 -04:00
Domenic Denicola
36502fe3f6 Spot fixes for Ward Arc 2, Flare 2020-10-11 15:25:56 -04:00
Domenic Denicola
bd4360a793 Spot fixes for Ward Arc 1, Daybreak 2020-10-10 14:19:22 -04:00
Domenic Denicola
84a9540497 Improve <b> and <strong> placement 2020-10-10 14:19:22 -04:00
Domenic Denicola
6ba3246598 Fix all the "[email protected]" instances 
I somehow thought there were only two, but in fact there are a lot.
 2020-10-10 14:18:49 -04:00
Domenic Denicola
60c23f0240 Minor cleanups in books.js 2020-07-01 17:38:35 -04:00
Domenic Denicola
ff991028af Normalize Ward separators to <hr> 2020-07-01 17:26:27 -04:00
Domenic Denicola
9e112adb81 Add some initial Ward substitutions 
This is just a first-few-pages spot check, so there's presumably much more to come.
 2020-07-01 17:23:05 -04:00
Domenic Denicola
559681e4ec Normalize Ward chapter titles 2020-07-01 17:23:05 -04:00
Domenic Denicola
2593540551 Strip off footer navigation links for Ward 
Since the text is now "Previous Chapter" instead of "Last Chapter" they weren't getting removed.
 2020-07-01 17:23:05 -04:00
Domenic Denicola
354fb46819 Add per-book covers 2020-07-01 17:23:05 -04:00
Domenic Denicola
a700e29299 Do not manually wrap book descriptions 
At least Calibre displays these with linebreaks as-is, which is unfortunate.
 2020-07-01 15:18:16 -04:00
Domenic Denicola
fd914b43f5 Start generalizing to work for Ward too 
* Updates the command-line options in various ways, notably changing --start-url to --book
* Renames the "book" directory to "staging"
* Abstracts out most book-specific data into books.js (but not yet cover or substitutions.json)
* Makes per-book subfolders under cache and staging directories
 2020-07-01 15:17:52 -04:00
Domenic Denicola
ecdadf8fd9 Update dependencies 
This includes eliminating some dependencies that are included in modern Node.js versions.
 2020-07-01 14:36:14 -04:00
Domenic Denicola
4386d48021 Add --jobs option for the convert command 
This doesn't seem that helpful as there seems to be a lot of sequential work going on regardless.
 2019-08-16 23:37:00 -04:00
Domenic Denicola
d4f009d67c Fix "grey" to "gray" (occurs four times) 
Closes #11.
 2019-08-16 23:19:45 -04:00
Domenic Denicola
93ef4c6779 Remove zfill dependency 
The language has padStart now.
 2019-08-16 22:48:35 -04:00
Domenic Denicola
b90fdd1df1 Spot fixes for Arc 12, Plague; additional hyphenation fixes 
Hyphenation fixes for self-destruct(ing) and life-threatening
 2019-08-16 22:33:47 -04:00
Domenic Denicola
34bb91fa67 Spot fixes for Arc 11, Infestation; additional general fixes 
The additional general fixes include:

* More of the never-ending italics/quotes fixes
* Fixed to use apostrophe instead of opening quote for "’Sup?"
* Standardized on the accent-including spelling of cliché
* Hyphenated "hard-headed"
 2019-08-16 22:16:36 -04:00
Len
ca289447f2 Remove substitutions updated at source 2019-08-16 22:14:00 -04:00
Domenic Denicola
ac667f9b99 Fix possessives of names ending in "s" 2018-04-22 15:29:42 -04:00
Domenic Denicola
169cb749af Spot fixes for Arc 10, Sentinel; additional general fixes 
The additional general fixes include:

* Fix hyphenation in "creepy-crawly" (and variants) and "well-armed"
* Fix capitalization of street and avenue names
 2018-04-22 15:29:42 -04:00
Domenic Denicola
36c396c006 Remove italics from more foreign names 2018-04-22 15:29:42 -04:00