Commit Graph

394 Commits

Author SHA1 Message Date
4pr0n
8efdc9490c Fix crash when logger can't be found 2015-02-20 11:55:25 -08:00
4_pr0n
e06cd1213d Merge pull request #172 from wraithfive/fix_imagefap
fix imagefap downloads
2015-02-20 11:54:50 -08:00
wraithfive
409db29bc4 fix imagefap downloads 2015-02-17 22:02:08 -06:00
4pr0n
fe33ced7d5 1.1.7 - Version bump for deviantart timeouts and history guessing 2015-02-12 22:48:31 -08:00
4pr0n
c5ea044f79 Various fixes to tests:
Ability to set log level, lots of debugging messages
Turn on debug logging during tests, simplified test cases for HTML ripper

Fix fusktator ripper, added test
Fixed gifyo, added test

Added tests for *all* rippers

Adding a few album-guessing URLs
2015-02-12 22:46:10 -08:00
4pr0n
41842c0850 Guess history based on rip folders, for #166
Still some work to do, but handles common rippers
2015-02-09 22:18:09 -08:00
4pr0n
069ad13f07 Increase timeout, avoid prefxies on deviantart rips
For #159 and #113 respectively
2015-02-07 23:49:21 -08:00
4pr0n
156a50d9f9 1.1.6 - Version bump for history fix and drawchan support 2015-02-07 23:40:27 -08:00
4pr0n
da58fee416 Error handling and warning when history can't be loaded 2015-02-07 23:39:27 -08:00
4pr0n
39a9edd1fa Support for DrawChan.net 2015-02-06 14:00:06 -08:00
4pr0n
597e9b3852 1.1.5 - Version bump for imagefap and 8muses fixes
Also various fixes to avoid deadlocking.
2015-02-06 12:04:07 -08:00
4pr0n
7235cac91a Ignore ads on 8muses ripper 2015-02-06 11:50:24 -08:00
4pr0n
bfd575906e Twitter ripper enhancements 2015-02-06 11:39:51 -08:00
4pr0n
c2bb65bc60 Trying to avoid thread deadlock when testing 2015-02-06 10:01:03 -08:00
4pr0n
9967332057 More improvements for unit tests 2015-02-06 03:37:24 -08:00
4pr0n
c524d20ccb Attempt to remove transient failure of tests 2015-02-06 03:01:02 -08:00
4pr0n
9c964e432e Better integration tests, testing out TravisCI 2015-02-05 23:58:17 -08:00
4pr0n
c2a9d680b2 1.1.4 - Fix deviantart 403 errors, fixes #159 2015-01-25 21:12:30 -08:00
4pr0n
3a7d6640f6 1.1.3 - Check Selected works now, Fixes #160 2015-01-25 20:36:51 -08:00
4pr0n
56254ab6bc 1.1.2 - Popup menu to check/uncheck history in bulk
Fixes #156
2015-01-13 01:28:47 -08:00
4pr0n
3c096add20 1.1.1 - Updated User-Agent, send referrer in reddit rips
Attempt to fix #155
2015-01-13 00:47:31 -08:00
4pr0n
8bb9a8d1c0 Fixing reddit ripper for single posts 2015-01-13 00:27:04 -08:00
4pr0n
72f1864e4e Delete empty Cheeby subdirectories 2015-01-11 15:20:01 -08:00
4pr0n
dc7762c327 1.1.0 - Version bump for new history and Cheeby rework 2015-01-11 15:10:28 -08:00
4pr0n
7fe17a8f00 Store Cheeby albums in separate folders
Single-image posts go in root directory.
Also maintain order of albums.

For #146
2015-01-11 15:07:38 -08:00
4pr0n
c3b82fff32 Better messaging when instagram rips fail
For #129
2015-01-11 05:39:36 -08:00
4pr0n
083cd8d7cc Logger enhancements
UI shows already-downloaded files as 'completed' instead of 'errored'.
No more "Retrieving" lines in UI log window.
WARN log levels all around.

Mostly for #147
2015-01-11 05:11:10 -08:00
4pr0n
dd55cd1b43 Adding features to "History"
Table-based view.
Tracks # of images in a rip, and dates.
Sortable.
Double-clicking URL allows copying the URL to clipboard.
Can selectively re-rip only albums that are 'checked'
'Checked' albums are persisted when RipMe is closed & reopened.

For #147 (selective re-ripping)
2015-01-11 04:31:30 -08:00
4pr0n
066b0e9f87 1.0.93 - version bump for fixes 2015-01-11 00:46:18 -08:00
4pr0n
4598b0bd38 Get full-size imgur images when ripping reddit users
Closes #142
2015-01-11 00:40:56 -08:00
4pr0n
439722d2e4 Send useragent and referer when downloading videos - fixes gfycat ripper 2015-01-11 00:28:41 -08:00
4pr0n
9e63783abc Storing number of files in history 2015-01-11 00:23:43 -08:00
4pr0n
afb7236db9 Sleep 2sec when fetching reddit pages 2015-01-11 00:07:45 -08:00
4pr0n
e253c87ba3 1.0.92 - Version bump for fixes & vid.me 2015-01-10 16:06:13 -08:00
4pr0n
9487236ca0 Follow 3xx redirects, support https downloads
Closes #151
2015-01-10 16:03:30 -08:00
4pr0n
2e01d63841 Fix pagination on Cheeby ripper
Closes #153
2015-01-10 15:41:41 -08:00
4pr0n
e6f41d5047 Fixing anoni-ib; pass referer when downloading images 2015-01-10 15:39:18 -08:00
4_pr0n
27bda1bc9f Merge pull request #144 from Wiiplay123/master
Added deviantART description ripping
2015-01-10 15:31:46 -08:00
4_pr0n
9770dfed32 Merge pull request #152 from aaaaan/master
Added vid.me ripper
2015-01-10 15:31:31 -08:00
aaaaan
d593cdd9f6 Added vid.me ripper
Rips a video from vidme.
Does not support ripping all videos of a user
2015-01-01 20:56:40 +01:00
Dimtree
ad78c78ec3 Added -d and -D flags, formatting
added -d (--saveorder) and -D (--nosaveorder) flags to control
'download.save_order' from the command line. Replaced some tabs with
spaces.
2014-12-23 23:19:52 -05:00
Wiiplay123
be89649466 Added line breaks to deviantART ripper
Finally added the support for newlines that I've been going on about in
the other commits. Also got rid of a comment that shouldn't have been
there, as well as fixing the fact that I just broke everything two
commits back and didn't notice until just now. Sorry about that!
2014-11-29 23:14:57 -06:00
Wiiplay123
16e0d27f66 Improved description ripping for deviantART
Also, added some functions to AbstractHTMLRipper that should allow
description ripping to be added to other rippers as well.
hasDescriptionSupport() is a function that will be overridden by a
ripper that supports descriptions, and will trigger the description
ripper. getDescription will grab the description from a page, and must
be overridden if you want to grab a description with a ripper.
2014-11-28 22:59:39 -06:00
Wiiplay123
72b40394ae Added deviantART description ripping
It needs some work, notably the description text file doesn't have
prefix. Also, fixed a resource leak in Utils.java
2014-11-28 09:50:04 -06:00
4pr0n
984c55a749 Fix minus bug when albums contained quotation marks
Closes #134
2014-11-27 03:29:31 -08:00
4pr0n
2ae790a49e Fix minus bug in #134 2014-11-27 03:17:36 -08:00
4pr0n
707f64c516 1.0.91 - Cleaning up ChanRipper, fix to work with anonib 2014-11-27 02:08:47 -08:00
g-3x
8df6a1612a Update XhamsterRipper.java
This will able the ripper to detect galleries with the de.xhamster subdomain.
2014-11-17 01:53:21 +01:00
4pr0n
bf933069c2 1.0.90 - Don't show error when ripping a valid URL
Closes #110
2014-10-21 03:04:06 -07:00
4pr0n
c163eadd23 1.0.89 - Fix fapproved ripper
Closes #118
2014-10-21 02:42:27 -07:00
4pr0n
95cc662331 1.0.88 - Fix imgbox rips 2014-10-21 01:37:25 -07:00
4pr0n
eb23e4fa82 1.0.87 - Motherless video ripper 2014-10-21 01:21:08 -07:00
4_pr0n
72ce875a74 Merge pull request #122 from sdt0001/master
Add scraper for idol.sankakucomplex.com tag albums.
2014-10-21 01:16:15 -07:00
Erwin de Haan
8b6c66da0c Fixed the Finebox ripper 2014-10-15 14:02:36 +02:00
SDT
79ffee2371 Add scraper for idol.sankakucomplex.com tag albums. 2014-10-15 16:27:51 +11:00
Erwin de Haan
80563991b1 Removed default netbeans license/author block. 2014-09-08 00:39:51 +02:00
Erwin de Haan
972c1dc75f Made ChanRipper more universal.
Added a nice way to add extra chan sites. This makes sure that the files
are the correct ones (self_hosted). Generic sites still work. Check
http://www.allchans.org/ sometime. And 4chan-x for the list of archives.
The "Can't rip this url" error now gives the message.
Added ChanSite Helper class.
Updates ChanRipperTest urls.

testVineboxAlbums is still failing.
2014-09-08 00:36:08 +02:00
4pr0n
e46e6733fa 1.0.86 - Fix imagefap albums larger than 1k images
Mentioned in #8
2014-08-15 22:07:59 -07:00
4pr0n
f8935af7d6 1.0.85 - Fix for Modelmayhem ripper
Closes #104
2014-08-15 21:55:24 -07:00
4pr0n
084f0e5eaa 1.0.84 - Bug fix: allow ripper to continue when stopped
Closes #106
2014-08-15 21:50:40 -07:00
4pr0n
91ef1c1b31 1.0.82 - Fix 2dgalleries ripper
Closes #96
2014-08-03 12:45:50 -07:00
4pr0n
1fc037358a 1.0.82 - Fix photobucket ripper, Autorip Toggle 2014-08-02 20:17:04 -07:00
4pr0n
44c1073dca Fix photobucket ripper
Closes #95
2014-08-02 20:16:11 -07:00
4pr0n
d4c6637eb2 Default to use appropriate API key for tumblr
Closes #101
2014-08-02 09:27:53 -07:00
4pr0n
badf69acb9 Clipboard Autorip config option for #103 2014-08-02 09:24:07 -07:00
4pr0n
ac859d8f6b 1.0.81 - Fixes for tumblr & seenive. Queue.
Tumblr fix: #102
New rippers: 2DGalleries , ShesFreaky #97
Queue system for rips #15
History is saved to history.json, has capability to save URL, dates, etc #83
2014-08-01 10:41:28 -07:00
4pr0n
158616e382 Fixing clipboard autorip 2014-08-01 10:41:28 -07:00
4pr0n
72fe3303e3 Better history
For #83, replaces existing system but doesn't use new features such as
date, image count, etc.
2014-08-01 10:41:28 -07:00
4pr0n
433aa1e46e Sort of added queueing/history
For #15
2014-08-01 10:41:23 -07:00
4pr0n
e303945d3d Save directories named after album titles are now optional 2014-08-01 10:21:08 -07:00
4pr0n
bc234efba6 Added 2dgalleries ripper
Closes #96
2014-08-01 10:21:08 -07:00
4pr0n
660bae8bab fix seenive ripper 2014-08-01 10:21:08 -07:00
CodeDestroyer
5d682ea8c7 removed extra line 2014-07-31 23:54:33 -04:00
CodeDestroyer
0499cd674c Fixed tumblr url redirect
Tumblr ripper did not account for potential none image urls in the
original_size field.  This is caused by larger images being sent to AWS
 If there is no extension i now get the response’s url and download the
file from AWS
2014-07-31 23:49:56 -04:00
4_pr0n
da8871ec57 Merge pull request #97 from starb0bby/master_4pr0n
Added ShesFreakyRipper (shesfreaky.com/gallery/...)
2014-07-24 23:15:35 -07:00
4pr0n
3d65f38430 1.0.80 - Fix butttoucher
Closes #91
2014-07-24 23:09:54 -07:00
starb0bby
b04547b889 Added ShesFreakyRipper (shesfreaky.com/gallery/...) 2014-07-24 10:02:53 -04:00
4pr0n
763a7445bf 1.0.79 - Support for ripping all images from cheeby 2014-07-21 03:04:05 -07:00
4pr0n
aa296ef72e 1.0.78 - Added BCFakes ripper #8 2014-07-20 01:35:51 -07:00
4pr0n
1057923709 Version bump for various fixes 2014-07-20 01:15:46 -07:00
4pr0n
562f224c21 Added cheeby ripper #8 2014-07-20 01:13:02 -07:00
4pr0n
29f210a468 Support for motherless groups
Isue #8
2014-07-20 01:04:28 -07:00
4pr0n
ae4949d07c Change application title while ripping
Closes #90
2014-07-20 00:59:25 -07:00
4pr0n
bdf8952f79 fix regex on reddit ripper & chan ripper
closes #89
2014-07-20 00:54:41 -07:00
4pr0n
6c84b192b7 1.0.76 - Taptastic ripper improvements
New (improved) filename scheme.
Shortened code length/complexity.
Can now rip all episodes in series from a single /episode/ page.
Code formatting the way I like it.

From pull request #86.
2014-07-01 22:49:52 -07:00
4_pr0n
a95bfa7928 Merge pull request #86 from trilader/master
Added Tapastic ripper
2014-07-01 22:07:45 -07:00
Daniel Schulte
6daa81bb42 Removing an extra space 2014-06-30 23:23:46 +02:00
Daniel Schulte
c8cb0c00b3 Added Tapastic ripper 2014-06-30 23:21:22 +02:00
4pr0n
315c703e3c 'Save URLs only' works for videos 2014-06-28 09:49:11 -07:00
4pr0n
97506c8741 Option to only save URLs to images, not download 2014-06-28 09:47:46 -07:00
4pr0n
baab27d6af 1.0.75 - 500px gets higher-res images #8 2014-06-28 01:40:28 -07:00
4pr0n
c7fce6a420 500px ripper, uses API, doesn't get full-size image 2014-06-28 00:53:17 -07:00
4pr0n
b0e5fa8cb0 Fixed furaffinity ripper. #84
Logs in correctly via https.
Spaces instead of tabs.
No more warnings.
2014-06-27 23:20:52 -07:00
4_pr0n
9e40e55ee9 Merge pull request #84 from trilader/master
Furaffinity ripper.
2014-06-27 20:37:16 -07:00
4pr0n
cda864a1b9 1.0.74 - Videarn video ripper #8 2014-06-27 20:21:16 -07:00
Daniel Schulte
cce85e99cd Trying to hunt down the cookie bug 2014-06-27 22:44:27 +02:00
Daniel Schulte
5428cb8991 Trying to changed code to login the user instead of manually supplying cookie values.
Currently the "a" cookie does not get captured for some reason.
2014-06-27 22:40:03 +02:00
Daniel Schulte
ac04bb9053 Furaffinity ripper 2014-06-27 17:18:09 +02:00
4pr0n
5afbc1ce3a 1.0.73 - Datw.in ripper for #8 2014-06-26 00:48:39 -07:00
4pr0n
2fbcdba1a8 1.0.72 - Support for DeviantArt favourites for #82 2014-06-26 00:12:47 -07:00
4pr0n
53df6caf0a 1.0.71 - Fuskator ripper for #8 2014-06-25 23:22:42 -07:00
4pr0n
349804c968 1.0.70 Reddit ripper retrieves gfycat and vidble links
As requested in #8
2014-06-25 02:06:08 -07:00
4pr0n
eb8beae5dc Fix for ehentai ripper 2014-06-25 01:14:31 -07:00
4pr0n
104cbead5a Download via stream instead of Jsoup for #80 2014-06-25 01:14:05 -07:00
4pr0n
f8f3067099 Decrease maximum filename length for #77 2014-06-25 00:26:57 -07:00
4pr0n
7de64ffd5a Migrated existing rippers to use more abstraction, 2 new video rippers 2014-06-24 19:05:54 -07:00
4pr0n
b9e3d77449 Removed SinglePage ripper 2014-06-22 19:17:40 -07:00
4pr0n
c166f93d57 Moving from MultiPage ripper to HTML ripper, added JSON ripper 2014-06-22 19:12:29 -07:00
4pr0n
b7397cd31e Using new wrapper for HTTP requests, started abstract classes to simplify rippers 2014-06-21 17:08:42 -07:00
4pr0n
1b20e98f8f Unifying external page requests to a single method 2014-06-20 04:09:36 -07:00
4pr0n
d215beb7e3 Removing kinkyshare ripper (defunct site) 2014-06-20 03:25:21 -07:00
4pr0n
113a90120b 1.0.69 - Gfycat video ripper, instagram username fix
For #8
2014-06-20 02:00:45 -07:00
4pr0n
e9094b9e70 Apparently instagram usernames can contain periods 2014-06-17 02:00:12 -07:00
4pr0n
c79ce6c864 1.0.68 - version bump for imagevenue & hentaifoundry 2014-06-17 01:40:19 -07:00
4pr0n
ca4ed62971 Hentai-foundry ripper #8 2014-06-17 01:39:49 -07:00
4pr0n
838ad2a585 Imagevenue ripper #8 2014-06-17 01:39:32 -07:00
Christopher Douglas
5092809ff3 Added Pornhub album ripper 2014-06-14 01:09:15 -07:00
4pr0n
313f3b0de0 1.0.67 - Tumblr ripper can rip external domains
You have to enter the URL in a weird format, though.

For example, to rip `fiddle.se`, you need to try to rip:

`http://fiddle.se.tumblr.com`

Tags and /post/ rips are still supported
2014-06-13 23:14:55 -07:00
4pr0n
3d06bb51e2 1.0.66 Fixing GirlsOfDesire ripper #72 2014-06-12 23:14:19 -07:00
4pr0n
58264cacca Merge pull request #72 from metaprime/desire
[request feedback] removed magic constant; GirlsOfDesire ripper works except for server 403
2014-06-12 23:02:04 -07:00
4pr0n
568918877d 1.0.65 - Vidd.me video ripper 2014-06-12 22:54:06 -07:00
4pr0n
c6957331e7 1.0.64 - Imagebam ripper #8 2014-06-12 22:45:17 -07:00
4pr0n
15142dd898 1.0.63 - Hopefully fixing dead-lock issue while re-ripping all for #22 2014-06-12 20:43:53 -07:00
Christopher Douglas
f27d565e83 removed magic constant; GirlsOfDesire ripper works except for server 403 2014-06-12 02:38:31 -07:00
4pr0n
2307dc454a Increase auto-update timeout to 10 seconds #64 2014-06-12 00:38:19 -07:00
4pr0n
8b2d30496d 1.0.62 - Imgur album directories named after album #49 2014-06-12 00:24:12 -07:00
4pr0n
848a0757fa fixing https issue with URL validator 2014-06-11 23:01:16 -07:00
4pr0n
bcb2e704fb Reset log output file after rip 2014-06-11 23:00:08 -07:00
4pr0n
700440d033 1.0.61 - Logging is optional via configuration
Closes #66
2014-06-11 22:45:54 -07:00
4pr0n
e4c2b2e3fb 1.0.60 - Fixing crazy directory creation bug #67 2014-06-10 20:24:23 -07:00
4pr0n
ad984930ab Increasing timeout for instagram 2014-06-09 20:55:11 -07:00
4pr0n
add3c043b2 1.0.59 - Detect when an album can be ripped instantly #60 2014-06-07 19:54:36 -07:00
4pr0n
fe24620e47 1.0.58 - Logs are written to the album's subdirectory
Closes #61
2014-06-07 18:06:38 -07:00
4pr0n
e88d00ddee Fix for ehentai restricted galleries for #57 2014-06-07 18:06:22 -07:00
4pr0n
5d319355d3 1.0.57 - Nfsfw ripper #8 2014-06-07 12:10:36 -07:00
4pr0n
1c90e98bf2 1.0.56 - Fix for imgur rips
Should close #59
2014-06-07 01:25:39 -07:00
4pr0n
6c90522693 1.0.55 - Ehentai ripper bypasses content warning
Closes #57
2014-06-07 01:05:30 -07:00
4pr0n
574b03e45e 1.0.54 - Mediacru.sh ripper #8
This site requires encryption that isn't supported in older versions of Java.
RipMe will detect if the version of Java isn't compatible and suggest
downloading the latest version of Java from Oracle.
2014-06-06 00:30:49 -07:00
4pr0n
5dc0e25008 Cleaning up indentation 2014-06-04 20:31:11 -07:00
4pr0n
c5eb83a338 1.0.53 - 8Muses ripper can rip subalbums/comics
Should close #52 since it also grabs various image types that aren't
consistent across all albums
2014-06-04 20:28:14 -07:00
Kevin Lacquement
f05aac84c7 Added ability to skip retries on 404 errors. 2014-06-03 08:52:36 -07:00
4pr0n
13d13b28b7 1.0.52 - Imgbox ripper, notifications are optional
Both for #8

Popup notifications are now a config-option, defaults to false
2014-06-01 20:14:59 -07:00
4pr0n
f79f0cdc3c 1.0.51 - Deviantart rips full-size NSFW images #44 2014-06-01 02:02:36 -07:00
4pr0n
e9bee91aba 1.0.50 - Smutty.com ripper 2014-06-01 01:26:35 -07:00
4pr0n
cf7fbb9d3e 1.0.49 - Ehentai ripper revamped
For #41:
* Multi-threading
* Longer wait periods
* Rate-limit checks & retries
* New method for retrieving image from page
2014-06-01 00:04:43 -07:00
4pr0n
0073de17ea 1.0.48 - Imagestash.org /tag/ ripper #8 2014-05-30 05:37:10 -07:00
4pr0n
2947c3d56b Support 'album-' vk.com URLs 2014-05-30 05:37:10 -07:00
4pr0n
62538b8061 Improved logging on errors for #41 2014-05-30 05:36:35 -07:00
4pr0n
0783a99110 1.0.47 - E-hentai: URL validation, logs more info
For troubleshooting #41
2014-05-26 02:15:01 -07:00
4pr0n
3208bf07d6 Added Vidble album ripper #8 2014-05-26 02:14:14 -07:00