Commit Graph

278 Commits

Author SHA1 Message Date
4pr0n
41842c0850 Guess history based on rip folders, for #166
Still some work to do, but handles common rippers
2015-02-09 22:18:09 -08:00
4pr0n
069ad13f07 Increase timeout, avoid prefxies on deviantart rips
For #159 and #113 respectively
2015-02-07 23:49:21 -08:00
4pr0n
39a9edd1fa Support for DrawChan.net 2015-02-06 14:00:06 -08:00
4pr0n
7235cac91a Ignore ads on 8muses ripper 2015-02-06 11:50:24 -08:00
4pr0n
bfd575906e Twitter ripper enhancements 2015-02-06 11:39:51 -08:00
4pr0n
c2bb65bc60 Trying to avoid thread deadlock when testing 2015-02-06 10:01:03 -08:00
4pr0n
9967332057 More improvements for unit tests 2015-02-06 03:37:24 -08:00
4pr0n
c524d20ccb Attempt to remove transient failure of tests 2015-02-06 03:01:02 -08:00
4pr0n
9c964e432e Better integration tests, testing out TravisCI 2015-02-05 23:58:17 -08:00
4pr0n
c2a9d680b2 1.1.4 - Fix deviantart 403 errors, fixes #159 2015-01-25 21:12:30 -08:00
4pr0n
3c096add20 1.1.1 - Updated User-Agent, send referrer in reddit rips
Attempt to fix #155
2015-01-13 00:47:31 -08:00
4pr0n
8bb9a8d1c0 Fixing reddit ripper for single posts 2015-01-13 00:27:04 -08:00
4pr0n
72f1864e4e Delete empty Cheeby subdirectories 2015-01-11 15:20:01 -08:00
4pr0n
7fe17a8f00 Store Cheeby albums in separate folders
Single-image posts go in root directory.
Also maintain order of albums.

For #146
2015-01-11 15:07:38 -08:00
4pr0n
c3b82fff32 Better messaging when instagram rips fail
For #129
2015-01-11 05:39:36 -08:00
4pr0n
083cd8d7cc Logger enhancements
UI shows already-downloaded files as 'completed' instead of 'errored'.
No more "Retrieving" lines in UI log window.
WARN log levels all around.

Mostly for #147
2015-01-11 05:11:10 -08:00
4pr0n
dd55cd1b43 Adding features to "History"
Table-based view.
Tracks # of images in a rip, and dates.
Sortable.
Double-clicking URL allows copying the URL to clipboard.
Can selectively re-rip only albums that are 'checked'
'Checked' albums are persisted when RipMe is closed & reopened.

For #147 (selective re-ripping)
2015-01-11 04:31:30 -08:00
4pr0n
439722d2e4 Send useragent and referer when downloading videos - fixes gfycat ripper 2015-01-11 00:28:41 -08:00
4pr0n
9e63783abc Storing number of files in history 2015-01-11 00:23:43 -08:00
4pr0n
afb7236db9 Sleep 2sec when fetching reddit pages 2015-01-11 00:07:45 -08:00
4pr0n
9487236ca0 Follow 3xx redirects, support https downloads
Closes #151
2015-01-10 16:03:30 -08:00
4pr0n
2e01d63841 Fix pagination on Cheeby ripper
Closes #153
2015-01-10 15:41:41 -08:00
4pr0n
e6f41d5047 Fixing anoni-ib; pass referer when downloading images 2015-01-10 15:39:18 -08:00
4_pr0n
27bda1bc9f Merge pull request #144 from Wiiplay123/master
Added deviantART description ripping
2015-01-10 15:31:46 -08:00
aaaaan
d593cdd9f6 Added vid.me ripper
Rips a video from vidme.
Does not support ripping all videos of a user
2015-01-01 20:56:40 +01:00
Wiiplay123
be89649466 Added line breaks to deviantART ripper
Finally added the support for newlines that I've been going on about in
the other commits. Also got rid of a comment that shouldn't have been
there, as well as fixing the fact that I just broke everything two
commits back and didn't notice until just now. Sorry about that!
2014-11-29 23:14:57 -06:00
Wiiplay123
16e0d27f66 Improved description ripping for deviantART
Also, added some functions to AbstractHTMLRipper that should allow
description ripping to be added to other rippers as well.
hasDescriptionSupport() is a function that will be overridden by a
ripper that supports descriptions, and will trigger the description
ripper. getDescription will grab the description from a page, and must
be overridden if you want to grab a description with a ripper.
2014-11-28 22:59:39 -06:00
Wiiplay123
72b40394ae Added deviantART description ripping
It needs some work, notably the description text file doesn't have
prefix. Also, fixed a resource leak in Utils.java
2014-11-28 09:50:04 -06:00
4pr0n
984c55a749 Fix minus bug when albums contained quotation marks
Closes #134
2014-11-27 03:29:31 -08:00
4pr0n
2ae790a49e Fix minus bug in #134 2014-11-27 03:17:36 -08:00
4pr0n
707f64c516 1.0.91 - Cleaning up ChanRipper, fix to work with anonib 2014-11-27 02:08:47 -08:00
g-3x
8df6a1612a Update XhamsterRipper.java
This will able the ripper to detect galleries with the de.xhamster subdomain.
2014-11-17 01:53:21 +01:00
4pr0n
c163eadd23 1.0.89 - Fix fapproved ripper
Closes #118
2014-10-21 02:42:27 -07:00
4pr0n
95cc662331 1.0.88 - Fix imgbox rips 2014-10-21 01:37:25 -07:00
4pr0n
eb23e4fa82 1.0.87 - Motherless video ripper 2014-10-21 01:21:08 -07:00
4_pr0n
72ce875a74 Merge pull request #122 from sdt0001/master
Add scraper for idol.sankakucomplex.com tag albums.
2014-10-21 01:16:15 -07:00
Erwin de Haan
8b6c66da0c Fixed the Finebox ripper 2014-10-15 14:02:36 +02:00
SDT
79ffee2371 Add scraper for idol.sankakucomplex.com tag albums. 2014-10-15 16:27:51 +11:00
Erwin de Haan
80563991b1 Removed default netbeans license/author block. 2014-09-08 00:39:51 +02:00
Erwin de Haan
972c1dc75f Made ChanRipper more universal.
Added a nice way to add extra chan sites. This makes sure that the files
are the correct ones (self_hosted). Generic sites still work. Check
http://www.allchans.org/ sometime. And 4chan-x for the list of archives.
The "Can't rip this url" error now gives the message.
Added ChanSite Helper class.
Updates ChanRipperTest urls.

testVineboxAlbums is still failing.
2014-09-08 00:36:08 +02:00
4pr0n
e46e6733fa 1.0.86 - Fix imagefap albums larger than 1k images
Mentioned in #8
2014-08-15 22:07:59 -07:00
4pr0n
f8935af7d6 1.0.85 - Fix for Modelmayhem ripper
Closes #104
2014-08-15 21:55:24 -07:00
4pr0n
91ef1c1b31 1.0.82 - Fix 2dgalleries ripper
Closes #96
2014-08-03 12:45:50 -07:00
4pr0n
44c1073dca Fix photobucket ripper
Closes #95
2014-08-02 20:16:11 -07:00
4pr0n
d4c6637eb2 Default to use appropriate API key for tumblr
Closes #101
2014-08-02 09:27:53 -07:00
4pr0n
e303945d3d Save directories named after album titles are now optional 2014-08-01 10:21:08 -07:00
4pr0n
bc234efba6 Added 2dgalleries ripper
Closes #96
2014-08-01 10:21:08 -07:00
4pr0n
660bae8bab fix seenive ripper 2014-08-01 10:21:08 -07:00
CodeDestroyer
5d682ea8c7 removed extra line 2014-07-31 23:54:33 -04:00
CodeDestroyer
0499cd674c Fixed tumblr url redirect
Tumblr ripper did not account for potential none image urls in the
original_size field.  This is caused by larger images being sent to AWS
 If there is no extension i now get the response’s url and download the
file from AWS
2014-07-31 23:49:56 -04:00
4_pr0n
da8871ec57 Merge pull request #97 from starb0bby/master_4pr0n
Added ShesFreakyRipper (shesfreaky.com/gallery/...)
2014-07-24 23:15:35 -07:00
4pr0n
3d65f38430 1.0.80 - Fix butttoucher
Closes #91
2014-07-24 23:09:54 -07:00
starb0bby
b04547b889 Added ShesFreakyRipper (shesfreaky.com/gallery/...) 2014-07-24 10:02:53 -04:00
4pr0n
763a7445bf 1.0.79 - Support for ripping all images from cheeby 2014-07-21 03:04:05 -07:00
4pr0n
aa296ef72e 1.0.78 - Added BCFakes ripper #8 2014-07-20 01:35:51 -07:00
4pr0n
562f224c21 Added cheeby ripper #8 2014-07-20 01:13:02 -07:00
4pr0n
29f210a468 Support for motherless groups
Isue #8
2014-07-20 01:04:28 -07:00
4pr0n
bdf8952f79 fix regex on reddit ripper & chan ripper
closes #89
2014-07-20 00:54:41 -07:00
4pr0n
6c84b192b7 1.0.76 - Taptastic ripper improvements
New (improved) filename scheme.
Shortened code length/complexity.
Can now rip all episodes in series from a single /episode/ page.
Code formatting the way I like it.

From pull request #86.
2014-07-01 22:49:52 -07:00
4_pr0n
a95bfa7928 Merge pull request #86 from trilader/master
Added Tapastic ripper
2014-07-01 22:07:45 -07:00
Daniel Schulte
6daa81bb42 Removing an extra space 2014-06-30 23:23:46 +02:00
Daniel Schulte
c8cb0c00b3 Added Tapastic ripper 2014-06-30 23:21:22 +02:00
4pr0n
315c703e3c 'Save URLs only' works for videos 2014-06-28 09:49:11 -07:00
4pr0n
97506c8741 Option to only save URLs to images, not download 2014-06-28 09:47:46 -07:00
4pr0n
baab27d6af 1.0.75 - 500px gets higher-res images #8 2014-06-28 01:40:28 -07:00
4pr0n
c7fce6a420 500px ripper, uses API, doesn't get full-size image 2014-06-28 00:53:17 -07:00
4pr0n
b0e5fa8cb0 Fixed furaffinity ripper. #84
Logs in correctly via https.
Spaces instead of tabs.
No more warnings.
2014-06-27 23:20:52 -07:00
4_pr0n
9e40e55ee9 Merge pull request #84 from trilader/master
Furaffinity ripper.
2014-06-27 20:37:16 -07:00
4pr0n
cda864a1b9 1.0.74 - Videarn video ripper #8 2014-06-27 20:21:16 -07:00
Daniel Schulte
cce85e99cd Trying to hunt down the cookie bug 2014-06-27 22:44:27 +02:00
Daniel Schulte
5428cb8991 Trying to changed code to login the user instead of manually supplying cookie values.
Currently the "a" cookie does not get captured for some reason.
2014-06-27 22:40:03 +02:00
Daniel Schulte
ac04bb9053 Furaffinity ripper 2014-06-27 17:18:09 +02:00
4pr0n
5afbc1ce3a 1.0.73 - Datw.in ripper for #8 2014-06-26 00:48:39 -07:00
4pr0n
2fbcdba1a8 1.0.72 - Support for DeviantArt favourites for #82 2014-06-26 00:12:47 -07:00
4pr0n
53df6caf0a 1.0.71 - Fuskator ripper for #8 2014-06-25 23:22:42 -07:00
4pr0n
349804c968 1.0.70 Reddit ripper retrieves gfycat and vidble links
As requested in #8
2014-06-25 02:06:08 -07:00
4pr0n
eb8beae5dc Fix for ehentai ripper 2014-06-25 01:14:31 -07:00
4pr0n
104cbead5a Download via stream instead of Jsoup for #80 2014-06-25 01:14:05 -07:00
4pr0n
7de64ffd5a Migrated existing rippers to use more abstraction, 2 new video rippers 2014-06-24 19:05:54 -07:00
4pr0n
b9e3d77449 Removed SinglePage ripper 2014-06-22 19:17:40 -07:00
4pr0n
c166f93d57 Moving from MultiPage ripper to HTML ripper, added JSON ripper 2014-06-22 19:12:29 -07:00
4pr0n
b7397cd31e Using new wrapper for HTTP requests, started abstract classes to simplify rippers 2014-06-21 17:08:42 -07:00
4pr0n
1b20e98f8f Unifying external page requests to a single method 2014-06-20 04:09:36 -07:00
4pr0n
d215beb7e3 Removing kinkyshare ripper (defunct site) 2014-06-20 03:25:21 -07:00
4pr0n
113a90120b 1.0.69 - Gfycat video ripper, instagram username fix
For #8
2014-06-20 02:00:45 -07:00
4pr0n
e9094b9e70 Apparently instagram usernames can contain periods 2014-06-17 02:00:12 -07:00
4pr0n
ca4ed62971 Hentai-foundry ripper #8 2014-06-17 01:39:49 -07:00
4pr0n
838ad2a585 Imagevenue ripper #8 2014-06-17 01:39:32 -07:00
Christopher Douglas
5092809ff3 Added Pornhub album ripper 2014-06-14 01:09:15 -07:00
4pr0n
313f3b0de0 1.0.67 - Tumblr ripper can rip external domains
You have to enter the URL in a weird format, though.

For example, to rip `fiddle.se`, you need to try to rip:

`http://fiddle.se.tumblr.com`

Tags and /post/ rips are still supported
2014-06-13 23:14:55 -07:00
4pr0n
3d06bb51e2 1.0.66 Fixing GirlsOfDesire ripper #72 2014-06-12 23:14:19 -07:00
4pr0n
58264cacca Merge pull request #72 from metaprime/desire
[request feedback] removed magic constant; GirlsOfDesire ripper works except for server 403
2014-06-12 23:02:04 -07:00
4pr0n
568918877d 1.0.65 - Vidd.me video ripper 2014-06-12 22:54:06 -07:00
4pr0n
c6957331e7 1.0.64 - Imagebam ripper #8 2014-06-12 22:45:17 -07:00
Christopher Douglas
f27d565e83 removed magic constant; GirlsOfDesire ripper works except for server 403 2014-06-12 02:38:31 -07:00
4pr0n
8b2d30496d 1.0.62 - Imgur album directories named after album #49 2014-06-12 00:24:12 -07:00
4pr0n
bcb2e704fb Reset log output file after rip 2014-06-11 23:00:08 -07:00
4pr0n
700440d033 1.0.61 - Logging is optional via configuration
Closes #66
2014-06-11 22:45:54 -07:00
4pr0n
e4c2b2e3fb 1.0.60 - Fixing crazy directory creation bug #67 2014-06-10 20:24:23 -07:00
4pr0n
ad984930ab Increasing timeout for instagram 2014-06-09 20:55:11 -07:00