Commit Graph

682 Commits

Author SHA1 Message Date
cyian-1756
ec399007f2 Style changes 2017-09-05 14:40:40 -04:00
cyian-1756
f643172cef Removed extra newlines 2017-09-05 14:37:48 -04:00
cyian-1756
b1ed146c3b Added cfake.com ripper 2017-09-04 22:03:27 -04:00
cyian-1756
1df516a9f9 Added viewcomic ripper 2017-09-04 15:22:50 -04:00
rephormat
c5f6367fe6 Fixes RipMeApp/ripme#57 2017-08-23 12:40:19 -05:00
cyian-1756
e323495b65 Webtoon ripper can now rip from all pages 2017-08-19 00:27:00 -04:00
cyian-1756
47c67b1733 Added basic webtoons ripper 2017-08-19 00:13:22 -04:00
cyian-1756
e9fd306985 Added ripper for erome.com (#48) 2017-08-12 13:28:06 -07:00
cyian-1756
3180372a9f Fixed ImagearnRipper (#45) 2017-08-12 03:40:04 -07:00
MetaPrime
1214d19187 Merge 4pr0n/ripme#493 from @cyian-1756/smutty. Adds http: before links. Fixes 4pr0n/ripme#442. 2017-08-12 03:20:02 -07:00
cyian-1756
274bf2f879 Now uses https for all links 2017-08-11 14:55:39 -04:00
cyian-1756
56422e0f00 Fixed 8muses ripper 2017-08-11 14:12:02 -04:00
cyian-1756
6c7e70bd56 Wordpress comic ripper Updates 2017-08-11 02:39:44 -07:00
cyian-1756
70ceec9f0d Added Luscious.net ripper (#24) 2017-08-11 02:18:23 -07:00
cyian-1756
f393060907 Changed 8muses image host 2017-08-10 10:12:10 -04:00
metaprime
e07d60a4ce Merge pull request #29 from cyian-1756/eroshare_mirror
Eroshareripper now uses mirror for data
2017-08-10 03:10:12 -07:00
metaprime
db4dcaba9b Merge pull request #30 from cyian-1756/aerisdies
Added basic support for aerisdies.com
2017-08-10 02:34:49 -07:00
cyian-1756
cdbdc995f1 Added eroshare mirror eroshae 2017-08-09 17:01:10 -04:00
cyian-1756
db5e7f0837 Added basic support for aerisdies.com 2017-08-01 20:45:58 -04:00
cyian-1756
fdf82f5126 changed regex to include eroshare.com 2017-07-29 21:51:41 -04:00
cyian-1756
fb6e23e7d6 Eroshareripper now uses mirror for data 2017-07-29 21:07:30 -04:00
cyian-1756
709ae1b13a switched up regex 2017-07-13 10:58:37 -04:00
Luke Payne
c37a7c351a Fixed Instagram Ripper cropping issue
Merged 4pr0n/ripme#592
Fixes 4pr0n/ripme#541
2017-07-05 01:07:39 -07:00
Luke Payne
cfab32d271 Updated xhamster ripper to support new URL format
Fixes 4pr0n/ripme#593
Fixes ripmeapp/ripme#4
2017-07-05 00:32:57 -07:00
cyian-1756
9d66de15e9 Removed hackish workaround 2017-06-28 13:12:14 -04:00
cyian-1756
09c9d2817a implmented hackish workaround 2017-06-25 15:36:31 -04:00
cyian-1756
021cd031ee Merge pull request #6 from cyian-1756/imgur
Removed dead code from imgur ripper and improved getAlbumTitle
2017-06-25 13:03:09 -04:00
cyian-1756
de4dac516b Fixed ripme erroring out when the rip finished 2017-06-25 12:42:12 -04:00
cyian-1756
7610ae89a7 Fixed 8muses ripper 2017-06-25 11:58:37 -04:00
cyian-1756
d2a3a7a9b4 Made default imgur title a constant 2017-06-22 14:07:12 -04:00
cyian-1756
a0e3307ffb Minor formating improvements 2017-06-22 14:04:53 -04:00
cyian-1756
4ae28c3af3 Improved imgur title grabbing 2017-06-22 09:48:17 -04:00
cyian-1756
36c86462ea Imgur ripper no longer adds Imgur: The most awesome images on the Internet to titles 2017-06-22 09:37:55 -04:00
MetaPrime
6eb9601528 Merge pull request #455 from cyian-1756/chevereto
Added a ripper for Chevereto
2017-06-21 09:35:15 -07:00
cyian-1756
d30c4b606d Removed broken json ripper 2017-06-19 20:17:07 -04:00
MetaPrime
71694196b9 Fix style 2017-06-19 10:45:15 -07:00
cyian-1756
128d384d29 Eroshare can now rip profiles (Fixes #465) (#578) 2017-06-15 12:21:08 -07:00
MetaPrime
b8294b8152 WordpressComicRipper: fix formatting 2017-06-06 10:25:27 -07:00
cyian-1756
90a8ab6f81 Wordpress comic ripper now supports more sites (#527)
* better filenaming for buttsmithy images

* Added better file naming for www.totempole666.com

* Added better file naming for http://themonsterunderthebed.net and fixed file naming if

* Added better filenaming for buttsmithy

* Added saw dust webcomic

* minor bug fixes and added support for http://freeadultcomix.com

* Added http://thisis.delvecomic.com

* added test links

* added comics-xxx.com

* removed uneeded sleep()s and == trues

* fixed prismblush.com naming
2017-06-06 10:22:14 -07:00
cyian-1756
4f8919e8d5 fixed sanitizeURL in IG ripper (#569) 2017-06-06 10:10:16 -07:00
MetaPrime
33520a205e Fix video rippers: Revert breaking change to exception handling. 2017-05-23 10:38:08 -07:00
cyian-1756
0c507c23aa Myhentaicomics ripper now rips all pages from tag and searches (#540)
* Now starts download right away when downloading from tags and searches
* Now rips from searches/tags ASAP
2017-05-23 09:59:49 -07:00
MetaPrime
89df4d7812 Merge pull request #547 from Gaboso/interfaces
Removed public modifier for methods on interfaces because it is redundant
2017-05-18 10:39:06 -07:00
Gaboso
c4ee75688c Remove all blank lines added previously in RipperInterface 2017-05-18 13:33:56 -04:00
MetaPrime
500120c762 Merge #538 @l1am9111: Add Instagram album support (Fixes #459)
Add support for Instagram albums
2017-05-18 10:27:48 -07:00
cyian-1756
29bf60c0da Added Eightmuses new cdn (#543) 2017-05-18 09:55:50 -07:00
Gaboso
44fe9885ab Removed public modifier for methods on interfaces because it is redundant. 2017-05-18 01:44:51 -04:00
MetaPrime
f08ae4ce4e Merge #516 @Wiiplay123: Fixed deviantArt ripping 2017-05-15 10:30:40 -07:00
MetaPrime
2055cb0d9d Fix indentation. 2017-05-15 10:28:45 -07:00
Wiiplay123
3d359be958 Added precaution for URLs with slashes at the end when determining file name
Made for my FurAffinity branch, brought it over to master branch because
it could come in handy for other things.
2017-05-14 20:15:27 -05:00
l1am9111
d43f14e4b2 Add support for Instagram albums
Adds support for the "carousel" data type
2017-05-12 19:09:49 +01:00
MetaPrime
7268a10ef3 Spacing around keywords and braces 2017-05-09 17:50:32 -07:00
MetaPrime
eb979cc1f6 Convert tabs to spaces. 2017-05-09 17:34:57 -07:00
MetaPrime
b6c925caae Various reformatting. 2017-05-09 16:16:17 -07:00
MetaPrime
cd8784ed85 Missing braces, various cleanup. 2017-05-09 16:16:17 -07:00
MetaPrime
92405fb9f8 WordpressComicRipper: fix indentation 2017-05-09 16:16:16 -07:00
MetaPrime
c75aad47d4 Completely reformatted XbooruRipper; add missing braces. 2017-05-09 16:16:11 -07:00
MetaPrime
56093cc1ad Completely reformatted PahealRipper; add missing braces. 2017-05-09 15:36:37 -07:00
MetaPrime
d2a4412a85 Convert tabs to spaces, remove some unused imports. 2017-05-09 15:35:43 -07:00
MetaPrime
65b11d1e00 Trim trailing whitespace, remove some unused imports. 2017-05-09 15:22:55 -07:00
MetaPrime
d8d7b5096a Various style cleanup. 2017-05-09 15:03:12 -07:00
MetaPrime
9410ea806c Revert style change which hurt readability. 2017-05-09 14:58:00 -07:00
torbica
6ca4ebd176 Twitter: added support for video and multiple-image tweets (#478) 2017-05-09 14:42:14 -07:00
cyian-1756
a38597d6fe Added ASAP ripping to Myhentaicomics ripper (#476) 2017-05-09 14:11:17 -07:00
Erwin de Haan
441790bb3c ChanRipper: now downloads imgur links, etc. (#185) 2017-05-09 14:02:24 -07:00
MetaPrime
2ea059c2d3 Fix furaffinity text file naming. Closes #479 2017-05-09 13:40:22 -07:00
MetaPrime
b64a649635 Merge pull request #480 from cyian-1756/furaffinity
Minor css updates to Furaffinity ripper
2017-05-09 13:19:11 -07:00
cyian-1756
269d892388 Fixed SSL error with ep.xhamster domain (#520) 2017-05-09 12:36:27 -07:00
Josh Kastang
8fe94647dd Merge #524: Fix instagram cropping issue. Fixes #519, Fixes #499 2017-05-09 12:16:31 -07:00
MetaPrime
2a39ef63a9 Merge pull request #497 from cyian-1756/wordpressComicRipper
Wordpress comic ripper
2017-05-09 02:45:16 -07:00
Wiiplay123
624c28befa Fixed deviantArt download link resolving
Turns out getURL works perfectly fine, but the Location header doesn't.
2017-04-29 21:07:49 -05:00
Wiiplay123
8f409eb28a Fixed deviantArt downloading low res when higher res is available
Also fixed a few bugs related to non-image items that crashed the rip.
2017-04-29 14:35:39 -05:00
Wiiplay123
d55cf06c90 Merge remote-tracking branch 'refs/remotes/4pr0n/master' 2017-04-29 14:14:06 -05:00
MetaPrime
d728d64575 Merge pull request #481 from cyian-1756/HentaiFoundry
Changed hentaifoundry file name format
2017-04-28 10:41:05 -07:00
Wiiplay123
4cf9f09293 Fixed deviantArt "no next page found" error
The pagination buttons are gone. The "coffset" buttons for comment
pages, not gallery pages. I patched this by using a link found in the
HTML itself that I think is used by JavaScript to generate the
pagination buttons.
2017-04-27 00:18:42 -05:00
Wiiplay123
f2afb840dd Fixed deviantArt description file name issue.
The deviantArt description file name will now match the image file name,
rather than the URL.
2017-04-26 23:13:11 -05:00
Wiiplay123
8da945a8fe Fixed deviantArt description ripping again
Forgot to change an "a" to a "span", fixed now.
2017-04-25 21:18:03 -05:00
Wiiplay123
c3d1c7b654 Fixed deviantArt ripping
Uses the data-super-full-img attribute of thumbnails as first attempt to
get a full image URL. If that doesn't work (as is the case with mature
items), the JSON is used. thumbToFull is still broken in this commit,
but shouldn't be needed.
2017-04-25 20:17:26 -05:00
cyian-1756
a5e30634ad Now rips all pages 2017-04-25 14:42:57 -04:00
cyian-1756
d733e9f6dd now rips images of all sizes 2017-04-25 14:39:05 -04:00
cyian-1756
ac7cad038b Updated hentaifoundry ripper for new site css 2017-04-25 14:02:18 -04:00
metaprime
dbb926824a jagodibuja: fixed formatting 2017-04-25 10:09:00 -07:00
metaprime
f089e804fd Merge branch 'master' into m 2017-04-25 10:01:19 -07:00
cyian-1756
17b4f5fc32 Now cna rip all comics from jagodibuja.com 2017-04-25 07:31:04 -04:00
cyian-1756
1849fdba2d added ASAP ripping 2017-04-25 07:10:40 -04:00
cyian-1756
a953cc39b0 Added missing ; 2017-04-25 06:57:44 -04:00
metaprime
b69a663fcb Merge branch 'cyian-1756-xhamster' 2017-04-25 03:35:06 -07:00
metaprime
036cff3a30 Removed MinusRipper (dead website) 2017-04-25 03:20:54 -07:00
metaprime
74c7a39ae4 Merge branch 'cyian-1756-thechive' into pr495 2017-04-25 03:01:14 -07:00
metaprime
ef206fb7a6 Fix #370: Fix NewsfilterRipper. 2017-04-05 20:34:55 -07:00
cyian-1756
d241be1898 Jagodibuja now rips all comics 2017-03-29 08:04:19 -04:00
cyian-1756
810ef556b1 added basic support for Jagodibuja.com 2017-03-29 04:08:15 -04:00
cyian-1756
ecca3c123c added support for prismblush.com 2017-03-28 22:49:42 -04:00
cyian-1756
e4897c0463 Fixed naming bug in WordpressComicRipper.java 2017-03-28 22:24:42 -04:00
cyian-1756
78346bf1c4 added themonsterunderthebed.net 2017-03-28 22:20:58 -04:00
cyian-1756
ec77beaa63 added support for http://buttsmithy.com 2017-03-28 21:52:31 -04:00
cyian-1756
cb7899196e Added totempole666.com to WordpressComicRipper 2017-03-28 21:35:02 -04:00
cyian-1756
b8b706de90 Fix null error, Now rips all file types 2017-03-28 15:17:51 -04:00
cyian-1756
e71f2d392f Added support thechive.com 2017-03-28 09:29:27 -04:00
cyian-1756
23e464d0c1 improved xhamster cdn replacing regex 2017-03-24 17:58:17 -04:00
cyian-1756
fe3722674c Improved file naming 2017-03-23 21:06:22 -04:00
cyian-1756
be093b069a Improved naming 2017-03-23 20:40:15 -04:00
cyian-1756
ee949ed487 improved file naming 2017-03-23 19:23:03 -04:00
cyian-1756
6d352fcdc5 Fixed typo 2017-03-23 17:22:36 -04:00
cyian-1756
2ff45e8696 Changed imgur title grabbing to be less reliant on site style (#477) 2017-03-23 02:34:37 -07:00
metaprime
a3d8e87639 Merge pull request #486 from cyian-1756/eroshare
eroshare ripper now grabs album name

Fixes #460
2017-03-23 01:17:38 -07:00
cyian-1756
141478213c eroshare ripper now grabs album name 2017-03-19 19:50:29 -04:00
cyian-1756
3241ae0a84 ChevertoRipper now saves album title 2017-03-19 18:39:29 -04:00
cyian-1756
48345af6b4 fur affinity ripper can now save description 2017-03-19 18:31:17 -04:00
cyian-1756
5b426b4ca3 Updated getDescriptionsFromPage 2017-03-19 18:14:48 -04:00
cyian-1756
19a88b9d33 Added xhamsters new cdn domain 2017-03-19 13:35:24 -04:00
cyian-1756
2c0010f9df Changed hentaifoundry file name format 2017-03-17 18:09:52 -04:00
cyian-1756
b8b5cde728 Minor css updates to Furaffinity ripper 2017-03-17 17:33:36 -04:00
cyian-1756
b3873b26b4 SinnerComics: Added work around for naming bug (#472) 2017-03-14 14:16:33 -07:00
cyian-1756
97de669ac2 Tweaked regex, added tag-fox.com 2017-03-07 00:04:28 -05:00
cyian-1756
0a81eeac43 Removed logging line 2017-03-06 23:47:18 -05:00
cyian-1756
2c99c6140c Now rips full albums 2017-03-06 23:43:44 -05:00
cyian-1756
5595894992 removed none working site 2017-03-06 22:59:13 -05:00
metaprime
ec565c3864 Merge #428 from kas-luthor/fix-299: Rewritten E621 ripper 2017-03-02 01:30:09 -08:00
metaprime
90166d9bcf Merge #454 from cyian-1756/myhentaicomics: Added Myhentaicomics Ripper 2017-03-02 01:21:16 -08:00
metaprime
2eccc938a3 Merge #456 from cyian-1756/sinnercomics: Added ripper for sinner comics 2017-03-02 01:14:55 -08:00
metaprime
5ea46c8870 Merge pull request #430 from sodazona/master: Added ripper for zizki.com 2017-03-01 02:14:02 -08:00
metaprime
88bf900196 Merge #451 from @cyian-1756/8muses
This commit fixes the naming issue with 8muse comic issues (A comic with the name format of Comic_name/issue_X would be written to a folder called issue_X instead of comic_name_issue_X)

Also fixes #461 (8muses URL format changed)
2017-03-01 02:08:45 -08:00
cyian-1756
63801db258 Changed ripper to follow new url format 2017-02-28 02:40:16 -05:00
cyian-1756
94738b1647 Added ripper for sinner comics 2017-02-22 09:58:52 -05:00
cyian-1756
c42831fc63 added chevereto ripper 2017-02-22 09:47:25 -05:00
kas-luthor
ab91254226 Code style changes 2017-02-22 10:31:55 +01:00
cyian-1756
06e88efedf removed the unused g subdomain from the ehentai ripper (#453) 2017-02-21 22:24:52 -08:00
cyian-1756
334a124b9f Added missing subdomain for 4chan (#452) 2017-02-21 22:23:53 -08:00
cyian-1756
392d4b0ff5 Added basic chevereto ripper 2017-02-21 18:32:45 -05:00
cyian-1756
fd15ab8673 added missing ; 2017-02-21 17:29:34 -05:00
cyian-1756
5eaa8a7d8c Added Myhentaicomics Ripper 2017-02-21 17:14:59 -05:00
cyian-1756
44d71e6340 Fixed 8muses naming issue and removed catch for unthrown error 2017-02-21 15:39:52 -05:00
midweekmayhem
98438521a8 Added new ripper for http://nhentai.net/ 2017-02-08 15:27:43 +09:00
Sodazona
21476ec2eb Added ripper for zizki.com 2017-01-15 17:59:58 +00:00
kas-luthor
2f4793e9e3 Added utility functions for parsing URL queries
Rewrote E621Ripper to not use regexes anymore (therefore interacting
better with special chars in URLs)
2017-01-14 22:45:23 +01:00
MetaPrime
2ea2bee74a Fix #401: Imgbox: correctly convert thumbnail urls to full-size urls. 2016-12-27 23:14:25 -06:00
MetaPrime
8a70adbb05 Subreddit-scoped album URLs (partial support for #395). Other fixes.
* No need to set upper bound for number of characters in a GID, will
just cause maintenance headache down the road when GIDs get longer.
* Subreddit aggregator now supports scope /day

Note: This does not completely resolve subreddit-scoped URLs. Some of
them can be single images and the imgur ripper does not yet support
those. Support single-image rips first. Then, the page will need to be
loaded to dynamically detect whether it is a single-image or album
layout.
2016-12-21 07:35:20 -08:00
MetaPrime
40adcf245f Imgur: Update title detection (Fixes #394); prepend user_ in title of
user rips.

* Simplify album title detection using proper .post-title element on page.
* Combine album and gallery handling (was duplicated code).
* Prepend user_ before username on user rips:
  * [username].imgur.com -> imgur_user_[username]
* Fix allowDuplicates() logic.
2016-12-21 06:30:02 -08:00
metaprime
d025a777cd TumblrRipper: If API key from config fails, fall back on hardcoded default key. 2016-12-20 00:54:41 -08:00
John Gibson
a071d624b7 @jgibson02 #377: Updated Tumblr auth keys 2016-12-19 23:19:31 -08:00
metaprime
034f7ee181 ChanRipper: Add new image host domain for 4chan. 2016-12-19 19:49:36 -08:00
John Gibson
e149876dda Updated 8muses ripper to working status 2016-12-19 06:17:30 -08:00
Kastang
08ce833863 attempt at fixing issue #330 instagram api changes 2016-12-19 04:01:45 -08:00
root
6321aba898 @slauzon: Fix xHamster ripper for image galleries. Closes 4pr0n/ripme#360. 2016-12-19 03:42:29 -08:00
4pr0n
522b813587 1.2.13 - Luke-warm fix for imgur albums/images without descriptions
Closes #324
2016-04-23 21:04:16 -07:00
blth
2f7e5989a8 Update VidbleRipper.java 2016-04-17 12:52:57 -06:00
blth
6fa72d6bf2 Create EroShareRipper.java 2016-04-17 12:50:40 -06:00
4pr0n
68c6697207 1.2.12 - 500px: Support 'galleries' and subgalleries
Closes #282
2016-04-17 05:48:01 -07:00
4pr0n
1105c9c170 1.2.11 - DeviantArt fav subfolders, Reddituploads support
Allows ripping deviantart subfolders.
Closes #314

Support i.reddituploads.com in RedditRipper
Closes #308
2016-04-17 04:36:56 -07:00
4pr0n
12eda4080b 1.2.9 - Imgur fix (use /all), new tests, removed tests, etc.
Also updated the eclipse formatter config which, for some reason, was Tabs Only. Yeck

Version bump includes other pull requests. Hopefully they're fine...
2016-04-16 18:59:31 -07:00
i-cant-git
f95e319585 Use :orig instead of :large in TwitterRipper
This patch will allow TwitterRipper to download the original image instead of the resized large image

Normal image (600×300) → https://pbs.twimg.com/media/CCiZIc-WgAAc9vx.jpg
Large image (1024×512) → https://pbs.twimg.com/media/CCiZIc-WgAAc9vx.jpg:large
Original image (1280×640) → https://pbs.twimg.com/media/CCiZIc-WgAAc9vx.jpg:orig
2016-01-09 06:19:51 +02:00
4pr0n
b9d5347262 v1.2.8 - Option to prefer .MP4 over .GIF in imgur ripper.
Closes #266
2015-12-24 13:40:04 -08:00
4pr0n
bd70b6f4dd v1.2.7: Fix 500px to fetch NSFW images.
Closes #278
2015-12-22 21:10:30 -08:00
4pr0n
d4d6e4f57b v1.2.6: Fix 500px ripper to fetch higher-res, non-watermarked images.
Closes #260
2015-12-22 07:47:58 -08:00
4pr0n
9fd7bf7663 Fetch imgur series (comma-separated images) in Reddit ripper.
Closes #218
2015-12-21 14:47:07 -08:00
4pr0n
0ba092813c Image descriptions are configurable option (defaults to "on"). 2015-12-21 07:36:56 -08:00
4pr0n
22cee44345 Imgur: Accept /gallery/ URLs 2015-12-21 07:36:28 -08:00
4pr0n
d81dbed0f3 v1.2.4 - Fix instagram ripper. Closes #208 2015-12-20 15:38:42 -08:00
4pr0n
ee62463790 Fix tumblr: Error on non-post, non-tagged, non-root URLs
Closes #275
2015-12-20 15:26:26 -08:00
4pr0n
4ef66d067a Fix xhamster. Closes #276 2015-12-20 11:58:57 -08:00
4pr0n
e968b0e155 Cleaning up broken/unstable unit tests. 2015-12-20 11:24:42 -08:00
4pr0n
7aefba9d46 Fix/remove rippers, remove unstable unit tests.
1. Gonewild ripper - archive website down for good.
2. i.rarchives.com ripper - also down for good.
3. Seenive - down for good.
4. Beeg - Changed their encryption scheme to something fierce.
5. Fixed PornHub ripper -- works for videos and albums.
6. Fixed ShesFreaky ripper.
7. Removed *Chan rippers from unit tests, they keep failing hard.
2015-12-19 17:49:47 -08:00
4pr0n
407a19a483 Update imagefap ripper. Closes #271 2015-12-19 10:08:30 -08:00
4pr0n
5af0f95a3a Fix bugs in FuraffinityRipper 2015-12-19 06:46:43 -08:00
4pr0n
490062cf9e Fix gfycat, closes #269 2015-12-19 06:25:04 -08:00
4pr0n
cdb97f316b Fix bug in TamindirMp3 ripper. 2015-12-19 06:24:20 -08:00
4_pr0n
050861fe1d Merge pull request #267 from maheee/master
Add Rajce Ripper
2015-12-04 09:54:43 -08:00
4_pr0n
81b1bad226 Merge pull request #265 from kas-luthor/master
Added rippers for rule34.paheal.net, xbooru.com and e621.net
2015-12-04 09:54:26 -08:00
4_pr0n
8333417137 Merge pull request #257 from ghost/master
hey!
2015-12-04 09:53:11 -08:00
4_pr0n
b1e6703326 Merge pull request #227 from sukhois/master
Added a ripper for newsfilter.org galleries
2015-12-04 09:51:43 -08:00
4_pr0n
4433e5a2fe Merge pull request #220 from Wiiplay123/master
Added FurAffinity Description Ripping
2015-12-04 09:51:26 -08:00
4_pr0n
87353a44ca Merge pull request #186 from EraYaN/feature-nataliemu
Added Natalie.mu news album ripper.
2015-12-04 09:50:20 -08:00
4_pr0n
5e2f887482 Merge pull request #181 from metaprime/chan-update
ChanRipper - use subject as title. closes #180
2015-12-04 09:49:26 -08:00
4_pr0n
f7f57056ea Merge pull request #179 from metaprime/nudegals
NudeGalsRipper
2015-12-04 09:49:06 -08:00
fgts
3695f4b9da fix fgts.jp support 2015-12-04 23:55:23 +09:00
mahe
325d5d63b1 Add Rajce Ripper 2015-11-28 12:56:57 +01:00
kas-luthor
5951d51c7e added ripper for e621.net
refactored paheal.net and xbooru.com rippers:
- used absUrl() instead of plain attr()
- album names (and file names for paheal) now passed through filesystemSafe()
2015-11-27 00:45:14 +01:00
kas-luthor
bbc78ef67f added ripper for xbooru.com
removed license header for paheal ripper
added percent sign to url matching for paheal ripper
2015-11-26 22:18:24 +01:00
kas-luthor
6290aa1f35 added ripper for rule34.paheal.net
also implemented a file name limit of 128+4 characters since i got errors for too long filenames thanks to extensive tagging
2015-11-26 19:18:03 +01:00
jisuyame
7ecd2b54c1 Create tamindirmp3.java 2015-10-15 22:48:35 +03:00
jisuyame
12b4c8b14b Update AbstractHTMLRipper.java 2015-10-15 22:40:44 +03:00
jisuyame
94068436e8 Update AbstractHTMLRipper.java 2015-10-15 22:27:34 +03:00
4pr0n
9df47d6466 Remember state of queue if closed/crashed.
Closes #235
2015-09-17 03:29:11 -07:00
4pr0n
998035d17f Fix imagebam ripper.
Closes #238
Closes #237
2015-09-17 03:29:11 -07:00
4pr0n
d4c54b0f71 Fix 8muses. Closes #244 2015-09-17 03:29:10 -07:00
4_pr0n
4cb949a06e Merge pull request #243 from 0834dfbd2b/patch-1
Update InstagramRipper.java to support bigger images.
2015-09-17 03:24:36 -07:00
4pr0n
9b09852aea 1.1.9 - Hotfix for new imgur album format 2015-09-17 02:07:17 -07:00
0834dfbd2b
01b21d302b Update InstagramRipper.java
Make the instagram ripper to take the bigger images on instagram
2015-08-11 20:45:51 +02:00
Chikitulfo
b0a503b864 Fixed Newsfilter.org ripper for new webpage changes 2015-06-26 09:51:05 +02:00
sukhois
7bc45c2cda Added a ripper for newsfilter.org galleries 2015-06-19 07:52:26 +02:00
Erwin de Haan
0ba8786e0f Added Natalie.mu news album ripper.
Rips from both album and news pages.
2015-06-12 21:18:57 +02:00
Wiiplay123
e1fd37993d Added FurAffinity Description Ripping
Also added description sleep time value to AbstractHTMLRipper, to avoid
read timed out.
2015-05-29 13:26:48 -05:00
lfaoanl
21f7ddc435 Update InstagramRipper.java 2015-04-28 22:13:55 +01:00
4pr0n
f671c83500 Fixing Sankaku ripper and test 2015-03-30 21:54:04 -07:00
4pr0n
cdaa3b26d1 Fix imagestash, better exception logging on HTTP failures 2015-03-30 01:41:40 -07:00
4pr0n
1b9eea8499 Fix Finebox ripper 2015-03-30 01:36:15 -07:00
4pr0n
feb82b2dc5 Fixing DeviantArt ripper when no Download box is found 2015-03-30 01:32:27 -07:00
4pr0n
d92463ee57 1.1.8 - Update user-agent, unique UA for Reddit requests
for #191 #193 #189
2015-03-29 15:04:50 -07:00
Christopher Douglas
f8fe46f046 NudeGalsRipper 2015-02-22 21:58:09 -06:00
Christopher Douglas
67708a37ff ChanRipper - use subject as title. closes #180 2015-02-22 21:18:37 -06:00
4_pr0n
e06cd1213d Merge pull request #172 from wraithfive/fix_imagefap
fix imagefap downloads
2015-02-20 11:54:50 -08:00
wraithfive
409db29bc4 fix imagefap downloads 2015-02-17 22:02:08 -06:00
4pr0n
c5ea044f79 Various fixes to tests:
Ability to set log level, lots of debugging messages
Turn on debug logging during tests, simplified test cases for HTML ripper

Fix fusktator ripper, added test
Fixed gifyo, added test

Added tests for *all* rippers

Adding a few album-guessing URLs
2015-02-12 22:46:10 -08:00
4pr0n
41842c0850 Guess history based on rip folders, for #166
Still some work to do, but handles common rippers
2015-02-09 22:18:09 -08:00
4pr0n
069ad13f07 Increase timeout, avoid prefxies on deviantart rips
For #159 and #113 respectively
2015-02-07 23:49:21 -08:00
4pr0n
39a9edd1fa Support for DrawChan.net 2015-02-06 14:00:06 -08:00
4pr0n
7235cac91a Ignore ads on 8muses ripper 2015-02-06 11:50:24 -08:00
4pr0n
bfd575906e Twitter ripper enhancements 2015-02-06 11:39:51 -08:00
4pr0n
c2bb65bc60 Trying to avoid thread deadlock when testing 2015-02-06 10:01:03 -08:00
4pr0n
9967332057 More improvements for unit tests 2015-02-06 03:37:24 -08:00
4pr0n
c524d20ccb Attempt to remove transient failure of tests 2015-02-06 03:01:02 -08:00
4pr0n
9c964e432e Better integration tests, testing out TravisCI 2015-02-05 23:58:17 -08:00
4pr0n
c2a9d680b2 1.1.4 - Fix deviantart 403 errors, fixes #159 2015-01-25 21:12:30 -08:00
4pr0n
3c096add20 1.1.1 - Updated User-Agent, send referrer in reddit rips
Attempt to fix #155
2015-01-13 00:47:31 -08:00
4pr0n
8bb9a8d1c0 Fixing reddit ripper for single posts 2015-01-13 00:27:04 -08:00
4pr0n
72f1864e4e Delete empty Cheeby subdirectories 2015-01-11 15:20:01 -08:00
4pr0n
7fe17a8f00 Store Cheeby albums in separate folders
Single-image posts go in root directory.
Also maintain order of albums.

For #146
2015-01-11 15:07:38 -08:00
4pr0n
c3b82fff32 Better messaging when instagram rips fail
For #129
2015-01-11 05:39:36 -08:00
4pr0n
083cd8d7cc Logger enhancements
UI shows already-downloaded files as 'completed' instead of 'errored'.
No more "Retrieving" lines in UI log window.
WARN log levels all around.

Mostly for #147
2015-01-11 05:11:10 -08:00
4pr0n
dd55cd1b43 Adding features to "History"
Table-based view.
Tracks # of images in a rip, and dates.
Sortable.
Double-clicking URL allows copying the URL to clipboard.
Can selectively re-rip only albums that are 'checked'
'Checked' albums are persisted when RipMe is closed & reopened.

For #147 (selective re-ripping)
2015-01-11 04:31:30 -08:00
4pr0n
439722d2e4 Send useragent and referer when downloading videos - fixes gfycat ripper 2015-01-11 00:28:41 -08:00
4pr0n
9e63783abc Storing number of files in history 2015-01-11 00:23:43 -08:00
4pr0n
afb7236db9 Sleep 2sec when fetching reddit pages 2015-01-11 00:07:45 -08:00
4pr0n
9487236ca0 Follow 3xx redirects, support https downloads
Closes #151
2015-01-10 16:03:30 -08:00
4pr0n
2e01d63841 Fix pagination on Cheeby ripper
Closes #153
2015-01-10 15:41:41 -08:00
4pr0n
e6f41d5047 Fixing anoni-ib; pass referer when downloading images 2015-01-10 15:39:18 -08:00
4_pr0n
27bda1bc9f Merge pull request #144 from Wiiplay123/master
Added deviantART description ripping
2015-01-10 15:31:46 -08:00
aaaaan
d593cdd9f6 Added vid.me ripper
Rips a video from vidme.
Does not support ripping all videos of a user
2015-01-01 20:56:40 +01:00
Wiiplay123
be89649466 Added line breaks to deviantART ripper
Finally added the support for newlines that I've been going on about in
the other commits. Also got rid of a comment that shouldn't have been
there, as well as fixing the fact that I just broke everything two
commits back and didn't notice until just now. Sorry about that!
2014-11-29 23:14:57 -06:00
Wiiplay123
16e0d27f66 Improved description ripping for deviantART
Also, added some functions to AbstractHTMLRipper that should allow
description ripping to be added to other rippers as well.
hasDescriptionSupport() is a function that will be overridden by a
ripper that supports descriptions, and will trigger the description
ripper. getDescription will grab the description from a page, and must
be overridden if you want to grab a description with a ripper.
2014-11-28 22:59:39 -06:00
Wiiplay123
72b40394ae Added deviantART description ripping
It needs some work, notably the description text file doesn't have
prefix. Also, fixed a resource leak in Utils.java
2014-11-28 09:50:04 -06:00
4pr0n
984c55a749 Fix minus bug when albums contained quotation marks
Closes #134
2014-11-27 03:29:31 -08:00
4pr0n
2ae790a49e Fix minus bug in #134 2014-11-27 03:17:36 -08:00
4pr0n
707f64c516 1.0.91 - Cleaning up ChanRipper, fix to work with anonib 2014-11-27 02:08:47 -08:00
g-3x
8df6a1612a Update XhamsterRipper.java
This will able the ripper to detect galleries with the de.xhamster subdomain.
2014-11-17 01:53:21 +01:00
4pr0n
c163eadd23 1.0.89 - Fix fapproved ripper
Closes #118
2014-10-21 02:42:27 -07:00
4pr0n
95cc662331 1.0.88 - Fix imgbox rips 2014-10-21 01:37:25 -07:00
4pr0n
eb23e4fa82 1.0.87 - Motherless video ripper 2014-10-21 01:21:08 -07:00
4_pr0n
72ce875a74 Merge pull request #122 from sdt0001/master
Add scraper for idol.sankakucomplex.com tag albums.
2014-10-21 01:16:15 -07:00
Erwin de Haan
8b6c66da0c Fixed the Finebox ripper 2014-10-15 14:02:36 +02:00
SDT
79ffee2371 Add scraper for idol.sankakucomplex.com tag albums. 2014-10-15 16:27:51 +11:00
Erwin de Haan
80563991b1 Removed default netbeans license/author block. 2014-09-08 00:39:51 +02:00
Erwin de Haan
972c1dc75f Made ChanRipper more universal.
Added a nice way to add extra chan sites. This makes sure that the files
are the correct ones (self_hosted). Generic sites still work. Check
http://www.allchans.org/ sometime. And 4chan-x for the list of archives.
The "Can't rip this url" error now gives the message.
Added ChanSite Helper class.
Updates ChanRipperTest urls.

testVineboxAlbums is still failing.
2014-09-08 00:36:08 +02:00
4pr0n
e46e6733fa 1.0.86 - Fix imagefap albums larger than 1k images
Mentioned in #8
2014-08-15 22:07:59 -07:00
4pr0n
f8935af7d6 1.0.85 - Fix for Modelmayhem ripper
Closes #104
2014-08-15 21:55:24 -07:00
4pr0n
91ef1c1b31 1.0.82 - Fix 2dgalleries ripper
Closes #96
2014-08-03 12:45:50 -07:00
4pr0n
44c1073dca Fix photobucket ripper
Closes #95
2014-08-02 20:16:11 -07:00
4pr0n
d4c6637eb2 Default to use appropriate API key for tumblr
Closes #101
2014-08-02 09:27:53 -07:00
4pr0n
e303945d3d Save directories named after album titles are now optional 2014-08-01 10:21:08 -07:00
4pr0n
bc234efba6 Added 2dgalleries ripper
Closes #96
2014-08-01 10:21:08 -07:00
4pr0n
660bae8bab fix seenive ripper 2014-08-01 10:21:08 -07:00
CodeDestroyer
5d682ea8c7 removed extra line 2014-07-31 23:54:33 -04:00
CodeDestroyer
0499cd674c Fixed tumblr url redirect
Tumblr ripper did not account for potential none image urls in the
original_size field.  This is caused by larger images being sent to AWS
 If there is no extension i now get the response’s url and download the
file from AWS
2014-07-31 23:49:56 -04:00
4_pr0n
da8871ec57 Merge pull request #97 from starb0bby/master_4pr0n
Added ShesFreakyRipper (shesfreaky.com/gallery/...)
2014-07-24 23:15:35 -07:00
4pr0n
3d65f38430 1.0.80 - Fix butttoucher
Closes #91
2014-07-24 23:09:54 -07:00
starb0bby
b04547b889 Added ShesFreakyRipper (shesfreaky.com/gallery/...) 2014-07-24 10:02:53 -04:00
4pr0n
763a7445bf 1.0.79 - Support for ripping all images from cheeby 2014-07-21 03:04:05 -07:00
4pr0n
aa296ef72e 1.0.78 - Added BCFakes ripper #8 2014-07-20 01:35:51 -07:00
4pr0n
562f224c21 Added cheeby ripper #8 2014-07-20 01:13:02 -07:00
4pr0n
29f210a468 Support for motherless groups
Isue #8
2014-07-20 01:04:28 -07:00
4pr0n
bdf8952f79 fix regex on reddit ripper & chan ripper
closes #89
2014-07-20 00:54:41 -07:00
4pr0n
6c84b192b7 1.0.76 - Taptastic ripper improvements
New (improved) filename scheme.
Shortened code length/complexity.
Can now rip all episodes in series from a single /episode/ page.
Code formatting the way I like it.

From pull request #86.
2014-07-01 22:49:52 -07:00
4_pr0n
a95bfa7928 Merge pull request #86 from trilader/master
Added Tapastic ripper
2014-07-01 22:07:45 -07:00
Daniel Schulte
6daa81bb42 Removing an extra space 2014-06-30 23:23:46 +02:00
Daniel Schulte
c8cb0c00b3 Added Tapastic ripper 2014-06-30 23:21:22 +02:00
4pr0n
315c703e3c 'Save URLs only' works for videos 2014-06-28 09:49:11 -07:00
4pr0n
97506c8741 Option to only save URLs to images, not download 2014-06-28 09:47:46 -07:00
4pr0n
baab27d6af 1.0.75 - 500px gets higher-res images #8 2014-06-28 01:40:28 -07:00
4pr0n
c7fce6a420 500px ripper, uses API, doesn't get full-size image 2014-06-28 00:53:17 -07:00
4pr0n
b0e5fa8cb0 Fixed furaffinity ripper. #84
Logs in correctly via https.
Spaces instead of tabs.
No more warnings.
2014-06-27 23:20:52 -07:00
4_pr0n
9e40e55ee9 Merge pull request #84 from trilader/master
Furaffinity ripper.
2014-06-27 20:37:16 -07:00
4pr0n
cda864a1b9 1.0.74 - Videarn video ripper #8 2014-06-27 20:21:16 -07:00
Daniel Schulte
cce85e99cd Trying to hunt down the cookie bug 2014-06-27 22:44:27 +02:00
Daniel Schulte
5428cb8991 Trying to changed code to login the user instead of manually supplying cookie values.
Currently the "a" cookie does not get captured for some reason.
2014-06-27 22:40:03 +02:00
Daniel Schulte
ac04bb9053 Furaffinity ripper 2014-06-27 17:18:09 +02:00
4pr0n
5afbc1ce3a 1.0.73 - Datw.in ripper for #8 2014-06-26 00:48:39 -07:00
4pr0n
2fbcdba1a8 1.0.72 - Support for DeviantArt favourites for #82 2014-06-26 00:12:47 -07:00
4pr0n
53df6caf0a 1.0.71 - Fuskator ripper for #8 2014-06-25 23:22:42 -07:00
4pr0n
349804c968 1.0.70 Reddit ripper retrieves gfycat and vidble links
As requested in #8
2014-06-25 02:06:08 -07:00
4pr0n
eb8beae5dc Fix for ehentai ripper 2014-06-25 01:14:31 -07:00
4pr0n
104cbead5a Download via stream instead of Jsoup for #80 2014-06-25 01:14:05 -07:00
4pr0n
7de64ffd5a Migrated existing rippers to use more abstraction, 2 new video rippers 2014-06-24 19:05:54 -07:00
4pr0n
b9e3d77449 Removed SinglePage ripper 2014-06-22 19:17:40 -07:00
4pr0n
c166f93d57 Moving from MultiPage ripper to HTML ripper, added JSON ripper 2014-06-22 19:12:29 -07:00
4pr0n
b7397cd31e Using new wrapper for HTTP requests, started abstract classes to simplify rippers 2014-06-21 17:08:42 -07:00
4pr0n
1b20e98f8f Unifying external page requests to a single method 2014-06-20 04:09:36 -07:00
4pr0n
d215beb7e3 Removing kinkyshare ripper (defunct site) 2014-06-20 03:25:21 -07:00
4pr0n
113a90120b 1.0.69 - Gfycat video ripper, instagram username fix
For #8
2014-06-20 02:00:45 -07:00
4pr0n
e9094b9e70 Apparently instagram usernames can contain periods 2014-06-17 02:00:12 -07:00
4pr0n
ca4ed62971 Hentai-foundry ripper #8 2014-06-17 01:39:49 -07:00
4pr0n
838ad2a585 Imagevenue ripper #8 2014-06-17 01:39:32 -07:00
Christopher Douglas
5092809ff3 Added Pornhub album ripper 2014-06-14 01:09:15 -07:00
4pr0n
313f3b0de0 1.0.67 - Tumblr ripper can rip external domains
You have to enter the URL in a weird format, though.

For example, to rip `fiddle.se`, you need to try to rip:

`http://fiddle.se.tumblr.com`

Tags and /post/ rips are still supported
2014-06-13 23:14:55 -07:00
4pr0n
3d06bb51e2 1.0.66 Fixing GirlsOfDesire ripper #72 2014-06-12 23:14:19 -07:00
4pr0n
58264cacca Merge pull request #72 from metaprime/desire
[request feedback] removed magic constant; GirlsOfDesire ripper works except for server 403
2014-06-12 23:02:04 -07:00
4pr0n
568918877d 1.0.65 - Vidd.me video ripper 2014-06-12 22:54:06 -07:00
4pr0n
c6957331e7 1.0.64 - Imagebam ripper #8 2014-06-12 22:45:17 -07:00
Christopher Douglas
f27d565e83 removed magic constant; GirlsOfDesire ripper works except for server 403 2014-06-12 02:38:31 -07:00
4pr0n
8b2d30496d 1.0.62 - Imgur album directories named after album #49 2014-06-12 00:24:12 -07:00