cyian-1756
ef1cab60e1
Ripme now makes config dir and url_history file if they do not exist
2018-05-25 01:14:39 -04:00
cyian-1756
2977075a4b
Now checks that URLHistory exists and that we can write to it before trying to write to it
2018-05-24 13:43:54 -04:00
cyian-1756
d604d40596
Added option for addURLToDownload which sets the file extension to the files MIME type
2018-05-05 05:36:00 -04:00
cyian-1756
19ce96eae5
Fixed issue with downloading images without an extension
2018-04-23 15:58:01 -04:00
cyian-1756
c9c8542945
Added another overload to addURLToDownload which allows the ripper to set the name of the file; Fixed 8muses filename length issue
2018-03-12 12:40:13 -04:00
cyian-1756
e6c43bb482
Added the normalizeUrl func, which allows a ripper to normalize a url before adding it to url histroy/check if its in url history
2018-03-05 13:16:19 -05:00
cyian-1756
66739e4c7c
Implemented a last seen feature; Added comments
2018-02-25 18:10:30 -05:00
cyian-1756
80e746adbb
Merge pull request #313 from cyian-1756/api-changes
...
Added hasASAPRipping(), which if returns true allows a ripper to not return anything from getURLsFromPage()
2018-02-07 11:07:09 -05:00
Kevin Jiang
5b49514e3e
3 Metric Tons of Javadoc documentation for Core Ripper stuff.
...
There should be no changes to the code. Just a ton of documentation.
It should help newcomers get aquainted with code quicker.
2017-12-28 00:04:23 -05:00
cyian-1756
61169352cb
Moved hasASAPRipping() from AbstractHTMLRipper to AbstractRipper
2017-12-02 19:20:09 -05:00
metaprime
7716c47cc2
Fix #98 : Update User Agent to current most common UA (Chrome 61 on Windows 10 x64) ( #300 )
2017-11-29 23:11:35 -08:00
metaprime
fad35d1afb
Fix #211 : Add Utils.filesystemSanitized and apply to filename prefix. ( #213 )
2017-11-17 02:37:02 -08:00
cyian-1756
0b7dada59a
Remembering url history no longer causes unit tests to fail
2017-11-09 20:59:31 -05:00
cyian-1756
d5c1efd939
Now uses checkbox for remember.url_history setting
2017-11-07 15:23:41 -05:00
cyian-1756
9898c149e1
Added Utils.getURLHistoryFile() func to get the URL history file path, clearing history now deletes url history file
2017-11-07 04:49:39 -05:00
cyian-1756
169547d745
Change method that didn't need to be public to private
2017-11-07 04:27:36 -05:00
cyian-1756
c69613d8a5
Ripme now remembers downloaded URLs and doesn't try to redownload them
2017-11-07 04:11:13 -05:00
cyian-1756
d11443e8ec
Can amlost skip already downloaded urls
2017-11-05 14:35:15 -05:00
Julien Machiels
d043685d2e
Update to Java 8
...
* Changed the Maven target to 1.8
* Performed a preliminary cleanup using IntelliJ's Code Analysis (Only Java 7/8 updates and a few other entries in the Error and Warnings categories)
* Updated the readme to change the required Java version
2017-10-24 16:45:10 +02:00
MetaPrime
33520a205e
Fix video rippers: Revert breaking change to exception handling.
2017-05-23 10:38:08 -07:00
MetaPrime
d2a4412a85
Convert tabs to spaces, remove some unused imports.
2017-05-09 15:35:43 -07:00
MetaPrime
d8d7b5096a
Various style cleanup.
2017-05-09 15:03:12 -07:00
Erwin de Haan
441790bb3c
ChanRipper: now downloads imgur links, etc. ( #185 )
2017-05-09 14:02:24 -07:00
4pr0n
12eda4080b
1.2.9 - Imgur fix (use /all), new tests, removed tests, etc.
...
Also updated the eclipse formatter config which, for some reason, was Tabs Only. Yeck
Version bump includes other pull requests. Hopefully they're fine...
2016-04-16 18:59:31 -07:00
4pr0n
d4d6e4f57b
v1.2.6: Fix 500px ripper to fetch higher-res, non-watermarked images.
...
Closes #260
2015-12-22 07:47:58 -08:00
4pr0n
d92463ee57
1.1.8 - Update user-agent, unique UA for Reddit requests
...
for #191 #193 #189
2015-03-29 15:04:50 -07:00
4pr0n
c5ea044f79
Various fixes to tests:
...
Ability to set log level, lots of debugging messages
Turn on debug logging during tests, simplified test cases for HTML ripper
Fix fusktator ripper, added test
Fixed gifyo, added test
Added tests for *all* rippers
Adding a few album-guessing URLs
2015-02-12 22:46:10 -08:00
4pr0n
c2bb65bc60
Trying to avoid thread deadlock when testing
2015-02-06 10:01:03 -08:00
4pr0n
9c964e432e
Better integration tests, testing out TravisCI
2015-02-05 23:58:17 -08:00
4pr0n
3c096add20
1.1.1 - Updated User-Agent, send referrer in reddit rips
...
Attempt to fix #155
2015-01-13 00:47:31 -08:00
4pr0n
c3b82fff32
Better messaging when instagram rips fail
...
For #129
2015-01-11 05:39:36 -08:00
4pr0n
083cd8d7cc
Logger enhancements
...
UI shows already-downloaded files as 'completed' instead of 'errored'.
No more "Retrieving" lines in UI log window.
WARN log levels all around.
Mostly for #147
2015-01-11 05:11:10 -08:00
4pr0n
9e63783abc
Storing number of files in history
2015-01-11 00:23:43 -08:00
Wiiplay123
16e0d27f66
Improved description ripping for deviantART
...
Also, added some functions to AbstractHTMLRipper that should allow
description ripping to be added to other rippers as well.
hasDescriptionSupport() is a function that will be overridden by a
ripper that supports descriptions, and will trigger the description
ripper. getDescription will grab the description from a page, and must
be overridden if you want to grab a description with a ripper.
2014-11-28 22:59:39 -06:00
Wiiplay123
72b40394ae
Added deviantART description ripping
...
It needs some work, notably the description text file doesn't have
prefix. Also, fixed a resource leak in Utils.java
2014-11-28 09:50:04 -06:00
Erwin de Haan
8b6c66da0c
Fixed the Finebox ripper
2014-10-15 14:02:36 +02:00
4pr0n
97506c8741
Option to only save URLs to images, not download
2014-06-28 09:47:46 -07:00
4pr0n
b7397cd31e
Using new wrapper for HTTP requests, started abstract classes to simplify rippers
2014-06-21 17:08:42 -07:00
4pr0n
1b20e98f8f
Unifying external page requests to a single method
2014-06-20 04:09:36 -07:00
4pr0n
bcb2e704fb
Reset log output file after rip
2014-06-11 23:00:08 -07:00
4pr0n
700440d033
1.0.61 - Logging is optional via configuration
...
Closes #66
2014-06-11 22:45:54 -07:00
4pr0n
e4c2b2e3fb
1.0.60 - Fixing crazy directory creation bug #67
2014-06-10 20:24:23 -07:00
4pr0n
add3c043b2
1.0.59 - Detect when an album can be ripped instantly #60
2014-06-07 19:54:36 -07:00
4pr0n
fe24620e47
1.0.58 - Logs are written to the album's subdirectory
...
Closes #61
2014-06-07 18:06:38 -07:00
4pr0n
1c90e98bf2
1.0.56 - Fix for imgur rips
...
Should close #59
2014-06-07 01:25:39 -07:00
4pr0n
b50eb657f9
1.0.45 - ImageFap /gallery/ links. Closes #46
2014-05-25 20:16:14 -07:00
4pr0n
28b45e34ed
1.0.35 - Fixing i.rarchives ripper ( closes #34 )
...
Also fixed empty directory delete (waits for threads to finish first)
2014-05-04 22:57:57 -07:00
4pr0n
ab018abf03
Delete empty directories after rip
...
Closes #33
Also better error message handling when ripper errors.
2014-05-04 22:41:20 -07:00
4pr0n
6a45cd59e9
Better about box
2014-04-29 06:21:08 -07:00
4pr0n
a8728ece9f
Allowing rippers to pass referrer and cookies to download threads
2014-04-22 20:48:41 -07:00
