Commit Graph

467 Commits

Author SHA1 Message Date
blth
1d31903cdc Update RipUtils.java 2016-04-17 12:55:16 -06:00
blth
2f7e5989a8 Update VidbleRipper.java 2016-04-17 12:52:57 -06:00
blth
6fa72d6bf2 Create EroShareRipper.java 2016-04-17 12:50:40 -06:00
4pr0n
68c6697207 1.2.12 - 500px: Support 'galleries' and subgalleries
Closes #282
2016-04-17 05:48:01 -07:00
4pr0n
1105c9c170 1.2.11 - DeviantArt fav subfolders, Reddituploads support
Allows ripping deviantart subfolders.
Closes #314

Support i.reddituploads.com in RedditRipper
Closes #308
2016-04-17 04:36:56 -07:00
4pr0n
23b2a398fb 1.2.10 - Extract imgur /gallery/ images
Closes #316
2016-04-16 19:23:08 -07:00
4pr0n
12eda4080b 1.2.9 - Imgur fix (use /all), new tests, removed tests, etc.
Also updated the eclipse formatter config which, for some reason, was Tabs Only. Yeck

Version bump includes other pull requests. Hopefully they're fine...
2016-04-16 18:59:31 -07:00
4_pr0n
d8f346ed52 Merge pull request #294 from i-cant-git/patch-1
Use :orig instead of :large in TwitterRipper
2016-04-14 22:37:58 -07:00
Fabian-G
f96f7cc124 Added a command line option to avoid creation of properties file 2016-02-14 17:17:07 +01:00
i-cant-git
f95e319585 Use :orig instead of :large in TwitterRipper
This patch will allow TwitterRipper to download the original image instead of the resized large image

Normal image (600×300) → https://pbs.twimg.com/media/CCiZIc-WgAAc9vx.jpg
Large image (1024×512) → https://pbs.twimg.com/media/CCiZIc-WgAAc9vx.jpg:large
Original image (1280×640) → https://pbs.twimg.com/media/CCiZIc-WgAAc9vx.jpg:orig
2016-01-09 06:19:51 +02:00
4pr0n
b9d5347262 v1.2.8 - Option to prefer .MP4 over .GIF in imgur ripper.
Closes #266
2015-12-24 13:40:04 -08:00
4pr0n
bd70b6f4dd v1.2.7: Fix 500px to fetch NSFW images.
Closes #278
2015-12-22 21:10:30 -08:00
4pr0n
d4d6e4f57b v1.2.6: Fix 500px ripper to fetch higher-res, non-watermarked images.
Closes #260
2015-12-22 07:47:58 -08:00
4pr0n
61d86e5b7e Version bump to v1.2.5 2015-12-21 14:48:14 -08:00
4pr0n
9fd7bf7663 Fetch imgur series (comma-separated images) in Reddit ripper.
Closes #218
2015-12-21 14:47:07 -08:00
4pr0n
0ba092813c Image descriptions are configurable option (defaults to "on"). 2015-12-21 07:36:56 -08:00
4pr0n
22cee44345 Imgur: Accept /gallery/ URLs 2015-12-21 07:36:28 -08:00
4pr0n
d81dbed0f3 v1.2.4 - Fix instagram ripper. Closes #208 2015-12-20 15:38:42 -08:00
4pr0n
ab323056aa Version bump to 1.2.3 2015-12-20 15:31:31 -08:00
4pr0n
ee62463790 Fix tumblr: Error on non-post, non-tagged, non-root URLs
Closes #275
2015-12-20 15:26:26 -08:00
4pr0n
4ef66d067a Fix xhamster. Closes #276 2015-12-20 11:58:57 -08:00
4pr0n
5018d80b51 Remove/Clear queue option (right-click menu) 2015-12-20 11:58:37 -08:00
4pr0n
e968b0e155 Cleaning up broken/unstable unit tests. 2015-12-20 11:24:42 -08:00
4pr0n
7aefba9d46 Fix/remove rippers, remove unstable unit tests.
1. Gonewild ripper - archive website down for good.
2. i.rarchives.com ripper - also down for good.
3. Seenive - down for good.
4. Beeg - Changed their encryption scheme to something fierce.
5. Fixed PornHub ripper -- works for videos and albums.
6. Fixed ShesFreaky ripper.
7. Removed *Chan rippers from unit tests, they keep failing hard.
2015-12-19 17:49:47 -08:00
4pr0n
407a19a483 Update imagefap ripper. Closes #271 2015-12-19 10:08:30 -08:00
4pr0n
d25e285eed Version bump to v1.2.1 2015-12-19 06:54:24 -08:00
4pr0n
5af0f95a3a Fix bugs in FuraffinityRipper 2015-12-19 06:46:43 -08:00
4pr0n
490062cf9e Fix gfycat, closes #269 2015-12-19 06:25:04 -08:00
4pr0n
cdb97f316b Fix bug in TamindirMp3 ripper. 2015-12-19 06:24:20 -08:00
4_pr0n
050861fe1d Merge pull request #267 from maheee/master
Add Rajce Ripper
2015-12-04 09:54:43 -08:00
4_pr0n
81b1bad226 Merge pull request #265 from kas-luthor/master
Added rippers for rule34.paheal.net, xbooru.com and e621.net
2015-12-04 09:54:26 -08:00
4_pr0n
c8fdd9d0aa Merge pull request #259 from ProperGeezer/master
Add Command Arg -R to re-rip only selected history items
2015-12-04 09:53:57 -08:00
4_pr0n
8333417137 Merge pull request #257 from ghost/master
hey!
2015-12-04 09:53:11 -08:00
4_pr0n
8f66b02921 Merge pull request #254 from rmgy733/cli-improvements
Added the -l flag which allows the rip directory to be selected via t…
2015-12-04 09:52:23 -08:00
4_pr0n
b1e6703326 Merge pull request #227 from sukhois/master
Added a ripper for newsfilter.org galleries
2015-12-04 09:51:43 -08:00
4_pr0n
4433e5a2fe Merge pull request #220 from Wiiplay123/master
Added FurAffinity Description Ripping
2015-12-04 09:51:26 -08:00
4_pr0n
87353a44ca Merge pull request #186 from EraYaN/feature-nataliemu
Added Natalie.mu news album ripper.
2015-12-04 09:50:20 -08:00
4_pr0n
5e2f887482 Merge pull request #181 from metaprime/chan-update
ChanRipper - use subject as title. closes #180
2015-12-04 09:49:26 -08:00
4_pr0n
f7f57056ea Merge pull request #179 from metaprime/nudegals
NudeGalsRipper
2015-12-04 09:49:06 -08:00
fgts
3695f4b9da fix fgts.jp support 2015-12-04 23:55:23 +09:00
mahe
325d5d63b1 Add Rajce Ripper 2015-11-28 12:56:57 +01:00
kas-luthor
5951d51c7e added ripper for e621.net
refactored paheal.net and xbooru.com rippers:
- used absUrl() instead of plain attr()
- album names (and file names for paheal) now passed through filesystemSafe()
2015-11-27 00:45:14 +01:00
kas-luthor
bbc78ef67f added ripper for xbooru.com
removed license header for paheal ripper
added percent sign to url matching for paheal ripper
2015-11-26 22:18:24 +01:00
kas-luthor
6290aa1f35 added ripper for rule34.paheal.net
also implemented a file name limit of 128+4 characters since i got errors for too long filenames thanks to extensive tagging
2015-11-26 19:18:03 +01:00
ProperGeezer
9e411823a2 Made selected bool public
Made bool selected public in order for App.java able to access this information
2015-10-18 00:56:50 +01:00
ProperGeezer
77d6ffc825 Add -R to re-rip only selected history items
Added getHistory function to App.java to ensure the new -R argument could access the history to see whether an item is checked.

Added -R to the help options
2015-10-18 00:55:09 +01:00
jisuyame
7ecd2b54c1 Create tamindirmp3.java 2015-10-15 22:48:35 +03:00
jisuyame
12b4c8b14b Update AbstractHTMLRipper.java 2015-10-15 22:40:44 +03:00
jisuyame
94068436e8 Update AbstractHTMLRipper.java 2015-10-15 22:27:34 +03:00
Josh Grochowski
fe39ed8ed7 Added the -l flag which allows the rip directory to be selected via the command line 2015-10-11 16:19:31 -04:00
4pr0n
1255a76bf3 Revert "Add some type parameters to satisfy our generics gods."
This reverts commit 7f097049b8.

Had build errors, probably 'cause i'm using an old version of Java in my
build env.
2015-09-17 03:37:46 -07:00
4pr0n
55a3f6a218 1.2.0 - Version bump for latest fixes/features. 2015-09-17 03:29:11 -07:00
4pr0n
9df47d6466 Remember state of queue if closed/crashed.
Closes #235
2015-09-17 03:29:11 -07:00
4pr0n
998035d17f Fix imagebam ripper.
Closes #238
Closes #237
2015-09-17 03:29:11 -07:00
4pr0n
d4c54b0f71 Fix 8muses. Closes #244 2015-09-17 03:29:10 -07:00
4_pr0n
5d31eb4f1a Merge pull request #231 from drguildo/drguildo
Upate apache commons maven source, generic type parameters.
2015-09-17 03:29:04 -07:00
4_pr0n
4cb949a06e Merge pull request #243 from 0834dfbd2b/patch-1
Update InstagramRipper.java to support bigger images.
2015-09-17 03:24:36 -07:00
4pr0n
9b09852aea 1.1.9 - Hotfix for new imgur album format 2015-09-17 02:07:17 -07:00
0834dfbd2b
01b21d302b Update InstagramRipper.java
Make the instagram ripper to take the bigger images on instagram
2015-08-11 20:45:51 +02:00
Simon Morgan
7f097049b8 Add some type parameters to satisfy our generics gods. 2015-06-28 15:07:11 +01:00
Chikitulfo
b0a503b864 Fixed Newsfilter.org ripper for new webpage changes 2015-06-26 09:51:05 +02:00
sukhois
7bc45c2cda Added a ripper for newsfilter.org galleries 2015-06-19 07:52:26 +02:00
Erwin de Haan
0ba8786e0f Added Natalie.mu news album ripper.
Rips from both album and news pages.
2015-06-12 21:18:57 +02:00
Wiiplay123
e1fd37993d Added FurAffinity Description Ripping
Also added description sleep time value to AbstractHTMLRipper, to avoid
read timed out.
2015-05-29 13:26:48 -05:00
lfaoanl
21f7ddc435 Update InstagramRipper.java 2015-04-28 22:13:55 +01:00
4pr0n
f671c83500 Fixing Sankaku ripper and test 2015-03-30 21:54:04 -07:00
4pr0n
cdaa3b26d1 Fix imagestash, better exception logging on HTTP failures 2015-03-30 01:41:40 -07:00
4pr0n
1b9eea8499 Fix Finebox ripper 2015-03-30 01:36:15 -07:00
4pr0n
feb82b2dc5 Fixing DeviantArt ripper when no Download box is found 2015-03-30 01:32:27 -07:00
4pr0n
d92463ee57 1.1.8 - Update user-agent, unique UA for Reddit requests
for #191 #193 #189
2015-03-29 15:04:50 -07:00
Christopher Douglas
f8fe46f046 NudeGalsRipper 2015-02-22 21:58:09 -06:00
Christopher Douglas
67708a37ff ChanRipper - use subject as title. closes #180 2015-02-22 21:18:37 -06:00
4pr0n
6d040aa0d1 Validate config and reload default config if invalid
Should fix #158
2015-02-21 08:30:58 -08:00
4pr0n
8efdc9490c Fix crash when logger can't be found 2015-02-20 11:55:25 -08:00
4_pr0n
e06cd1213d Merge pull request #172 from wraithfive/fix_imagefap
fix imagefap downloads
2015-02-20 11:54:50 -08:00
wraithfive
409db29bc4 fix imagefap downloads 2015-02-17 22:02:08 -06:00
4pr0n
fe33ced7d5 1.1.7 - Version bump for deviantart timeouts and history guessing 2015-02-12 22:48:31 -08:00
4pr0n
c5ea044f79 Various fixes to tests:
Ability to set log level, lots of debugging messages
Turn on debug logging during tests, simplified test cases for HTML ripper

Fix fusktator ripper, added test
Fixed gifyo, added test

Added tests for *all* rippers

Adding a few album-guessing URLs
2015-02-12 22:46:10 -08:00
4pr0n
41842c0850 Guess history based on rip folders, for #166
Still some work to do, but handles common rippers
2015-02-09 22:18:09 -08:00
4pr0n
069ad13f07 Increase timeout, avoid prefxies on deviantart rips
For #159 and #113 respectively
2015-02-07 23:49:21 -08:00
4pr0n
156a50d9f9 1.1.6 - Version bump for history fix and drawchan support 2015-02-07 23:40:27 -08:00
4pr0n
da58fee416 Error handling and warning when history can't be loaded 2015-02-07 23:39:27 -08:00
4pr0n
39a9edd1fa Support for DrawChan.net 2015-02-06 14:00:06 -08:00
4pr0n
597e9b3852 1.1.5 - Version bump for imagefap and 8muses fixes
Also various fixes to avoid deadlocking.
2015-02-06 12:04:07 -08:00
4pr0n
7235cac91a Ignore ads on 8muses ripper 2015-02-06 11:50:24 -08:00
4pr0n
bfd575906e Twitter ripper enhancements 2015-02-06 11:39:51 -08:00
4pr0n
c2bb65bc60 Trying to avoid thread deadlock when testing 2015-02-06 10:01:03 -08:00
4pr0n
9967332057 More improvements for unit tests 2015-02-06 03:37:24 -08:00
4pr0n
c524d20ccb Attempt to remove transient failure of tests 2015-02-06 03:01:02 -08:00
4pr0n
9c964e432e Better integration tests, testing out TravisCI 2015-02-05 23:58:17 -08:00
4pr0n
c2a9d680b2 1.1.4 - Fix deviantart 403 errors, fixes #159 2015-01-25 21:12:30 -08:00
4pr0n
3a7d6640f6 1.1.3 - Check Selected works now, Fixes #160 2015-01-25 20:36:51 -08:00
4pr0n
56254ab6bc 1.1.2 - Popup menu to check/uncheck history in bulk
Fixes #156
2015-01-13 01:28:47 -08:00
4pr0n
3c096add20 1.1.1 - Updated User-Agent, send referrer in reddit rips
Attempt to fix #155
2015-01-13 00:47:31 -08:00
4pr0n
8bb9a8d1c0 Fixing reddit ripper for single posts 2015-01-13 00:27:04 -08:00
4pr0n
72f1864e4e Delete empty Cheeby subdirectories 2015-01-11 15:20:01 -08:00
4pr0n
dc7762c327 1.1.0 - Version bump for new history and Cheeby rework 2015-01-11 15:10:28 -08:00
4pr0n
7fe17a8f00 Store Cheeby albums in separate folders
Single-image posts go in root directory.
Also maintain order of albums.

For #146
2015-01-11 15:07:38 -08:00
4pr0n
c3b82fff32 Better messaging when instagram rips fail
For #129
2015-01-11 05:39:36 -08:00
4pr0n
083cd8d7cc Logger enhancements
UI shows already-downloaded files as 'completed' instead of 'errored'.
No more "Retrieving" lines in UI log window.
WARN log levels all around.

Mostly for #147
2015-01-11 05:11:10 -08:00
4pr0n
dd55cd1b43 Adding features to "History"
Table-based view.
Tracks # of images in a rip, and dates.
Sortable.
Double-clicking URL allows copying the URL to clipboard.
Can selectively re-rip only albums that are 'checked'
'Checked' albums are persisted when RipMe is closed & reopened.

For #147 (selective re-ripping)
2015-01-11 04:31:30 -08:00
4pr0n
066b0e9f87 1.0.93 - version bump for fixes 2015-01-11 00:46:18 -08:00
4pr0n
4598b0bd38 Get full-size imgur images when ripping reddit users
Closes #142
2015-01-11 00:40:56 -08:00
4pr0n
439722d2e4 Send useragent and referer when downloading videos - fixes gfycat ripper 2015-01-11 00:28:41 -08:00
4pr0n
9e63783abc Storing number of files in history 2015-01-11 00:23:43 -08:00
4pr0n
afb7236db9 Sleep 2sec when fetching reddit pages 2015-01-11 00:07:45 -08:00
4pr0n
e253c87ba3 1.0.92 - Version bump for fixes & vid.me 2015-01-10 16:06:13 -08:00
4pr0n
9487236ca0 Follow 3xx redirects, support https downloads
Closes #151
2015-01-10 16:03:30 -08:00
4pr0n
2e01d63841 Fix pagination on Cheeby ripper
Closes #153
2015-01-10 15:41:41 -08:00
4pr0n
e6f41d5047 Fixing anoni-ib; pass referer when downloading images 2015-01-10 15:39:18 -08:00
4_pr0n
27bda1bc9f Merge pull request #144 from Wiiplay123/master
Added deviantART description ripping
2015-01-10 15:31:46 -08:00
4_pr0n
9770dfed32 Merge pull request #152 from aaaaan/master
Added vid.me ripper
2015-01-10 15:31:31 -08:00
aaaaan
d593cdd9f6 Added vid.me ripper
Rips a video from vidme.
Does not support ripping all videos of a user
2015-01-01 20:56:40 +01:00
Dimtree
ad78c78ec3 Added -d and -D flags, formatting
added -d (--saveorder) and -D (--nosaveorder) flags to control
'download.save_order' from the command line. Replaced some tabs with
spaces.
2014-12-23 23:19:52 -05:00
Wiiplay123
be89649466 Added line breaks to deviantART ripper
Finally added the support for newlines that I've been going on about in
the other commits. Also got rid of a comment that shouldn't have been
there, as well as fixing the fact that I just broke everything two
commits back and didn't notice until just now. Sorry about that!
2014-11-29 23:14:57 -06:00
Wiiplay123
16e0d27f66 Improved description ripping for deviantART
Also, added some functions to AbstractHTMLRipper that should allow
description ripping to be added to other rippers as well.
hasDescriptionSupport() is a function that will be overridden by a
ripper that supports descriptions, and will trigger the description
ripper. getDescription will grab the description from a page, and must
be overridden if you want to grab a description with a ripper.
2014-11-28 22:59:39 -06:00
Wiiplay123
72b40394ae Added deviantART description ripping
It needs some work, notably the description text file doesn't have
prefix. Also, fixed a resource leak in Utils.java
2014-11-28 09:50:04 -06:00
4pr0n
984c55a749 Fix minus bug when albums contained quotation marks
Closes #134
2014-11-27 03:29:31 -08:00
4pr0n
2ae790a49e Fix minus bug in #134 2014-11-27 03:17:36 -08:00
4pr0n
707f64c516 1.0.91 - Cleaning up ChanRipper, fix to work with anonib 2014-11-27 02:08:47 -08:00
g-3x
8df6a1612a Update XhamsterRipper.java
This will able the ripper to detect galleries with the de.xhamster subdomain.
2014-11-17 01:53:21 +01:00
4pr0n
bf933069c2 1.0.90 - Don't show error when ripping a valid URL
Closes #110
2014-10-21 03:04:06 -07:00
4pr0n
c163eadd23 1.0.89 - Fix fapproved ripper
Closes #118
2014-10-21 02:42:27 -07:00
4pr0n
95cc662331 1.0.88 - Fix imgbox rips 2014-10-21 01:37:25 -07:00
4pr0n
eb23e4fa82 1.0.87 - Motherless video ripper 2014-10-21 01:21:08 -07:00
4_pr0n
72ce875a74 Merge pull request #122 from sdt0001/master
Add scraper for idol.sankakucomplex.com tag albums.
2014-10-21 01:16:15 -07:00
Erwin de Haan
8b6c66da0c Fixed the Finebox ripper 2014-10-15 14:02:36 +02:00
SDT
79ffee2371 Add scraper for idol.sankakucomplex.com tag albums. 2014-10-15 16:27:51 +11:00
Erwin de Haan
80563991b1 Removed default netbeans license/author block. 2014-09-08 00:39:51 +02:00
Erwin de Haan
972c1dc75f Made ChanRipper more universal.
Added a nice way to add extra chan sites. This makes sure that the files
are the correct ones (self_hosted). Generic sites still work. Check
http://www.allchans.org/ sometime. And 4chan-x for the list of archives.
The "Can't rip this url" error now gives the message.
Added ChanSite Helper class.
Updates ChanRipperTest urls.

testVineboxAlbums is still failing.
2014-09-08 00:36:08 +02:00
4pr0n
e46e6733fa 1.0.86 - Fix imagefap albums larger than 1k images
Mentioned in #8
2014-08-15 22:07:59 -07:00
4pr0n
f8935af7d6 1.0.85 - Fix for Modelmayhem ripper
Closes #104
2014-08-15 21:55:24 -07:00
4pr0n
084f0e5eaa 1.0.84 - Bug fix: allow ripper to continue when stopped
Closes #106
2014-08-15 21:50:40 -07:00
4pr0n
91ef1c1b31 1.0.82 - Fix 2dgalleries ripper
Closes #96
2014-08-03 12:45:50 -07:00
4pr0n
1fc037358a 1.0.82 - Fix photobucket ripper, Autorip Toggle 2014-08-02 20:17:04 -07:00
4pr0n
44c1073dca Fix photobucket ripper
Closes #95
2014-08-02 20:16:11 -07:00
4pr0n
d4c6637eb2 Default to use appropriate API key for tumblr
Closes #101
2014-08-02 09:27:53 -07:00
4pr0n
badf69acb9 Clipboard Autorip config option for #103 2014-08-02 09:24:07 -07:00
4pr0n
ac859d8f6b 1.0.81 - Fixes for tumblr & seenive. Queue.
Tumblr fix: #102
New rippers: 2DGalleries , ShesFreaky #97
Queue system for rips #15
History is saved to history.json, has capability to save URL, dates, etc #83
2014-08-01 10:41:28 -07:00
4pr0n
158616e382 Fixing clipboard autorip 2014-08-01 10:41:28 -07:00
4pr0n
72fe3303e3 Better history
For #83, replaces existing system but doesn't use new features such as
date, image count, etc.
2014-08-01 10:41:28 -07:00
4pr0n
433aa1e46e Sort of added queueing/history
For #15
2014-08-01 10:41:23 -07:00
4pr0n
e303945d3d Save directories named after album titles are now optional 2014-08-01 10:21:08 -07:00
4pr0n
bc234efba6 Added 2dgalleries ripper
Closes #96
2014-08-01 10:21:08 -07:00
4pr0n
660bae8bab fix seenive ripper 2014-08-01 10:21:08 -07:00
CodeDestroyer
5d682ea8c7 removed extra line 2014-07-31 23:54:33 -04:00
CodeDestroyer
0499cd674c Fixed tumblr url redirect
Tumblr ripper did not account for potential none image urls in the
original_size field.  This is caused by larger images being sent to AWS
 If there is no extension i now get the response’s url and download the
file from AWS
2014-07-31 23:49:56 -04:00
4_pr0n
da8871ec57 Merge pull request #97 from starb0bby/master_4pr0n
Added ShesFreakyRipper (shesfreaky.com/gallery/...)
2014-07-24 23:15:35 -07:00
4pr0n
3d65f38430 1.0.80 - Fix butttoucher
Closes #91
2014-07-24 23:09:54 -07:00
starb0bby
b04547b889 Added ShesFreakyRipper (shesfreaky.com/gallery/...) 2014-07-24 10:02:53 -04:00