Commit Graph

1296 Commits

Author SHA1 Message Date
cyian-1756
4074fcc448
Merge pull request #807 from cyian-1756/eromeVideos
Fixed erome video downloading
2018-07-14 14:48:43 -04:00
cyian-1756
0bf6381ede
Merge pull request #809 from cyian-1756/imagearn
Readded Imagearn ripper and test
2018-07-14 14:48:18 -04:00
cyian-1756
6cdf918ada
Merge pull request #788 from cyian-1756/loveromRipper
Loverom ripper [WIP]
2018-07-14 14:47:44 -04:00
cyian-1756
3f18d8a990 Readded Imagearn ripper and test 2018-07-13 20:06:54 -04:00
cyian-1756
3287b8c59a Fixed erome video downloading 2018-07-13 19:01:55 -04:00
cyian-1756
a65ad6f756 Fixed ManganeloRipper 2018-07-13 18:14:36 -04:00
Samuel P. Bowman
5622d55c3e Fix Issue 789: Implemented wraparound in log window and status label. 2018-07-13 13:19:54 -04:00
cyian-1756
3553118b54 Added support for Desuarchive.org 2018-07-12 13:44:45 -04:00
cyian-1756
35d24d22a5
Merge pull request #796 from cyian-1756/cli_crash_fix
No longer tries to send download compete message every time ripme sav…
2018-07-11 13:54:33 -04:00
cyian-1756
96738883b0
Merge pull request #791 from cyian-1756/deviantartGalleryFixes
Fixed minor bug with DeviantartRipper
2018-07-11 13:43:47 -04:00
cyian-1756
fc52da3497 No longer tries to send download compete message every time ripme saves a url to a text file 2018-07-11 13:40:09 -04:00
cyian-1756
67e2451744 Now properly names multi-part files; Updated to work with recent changes to site 2018-07-10 13:24:56 -04:00
cyian-1756
59dd904c22 Now prints error when ripme can't get a files type from the stream 2018-07-10 12:53:02 -04:00
cyian-1756
6c64f73daa Fixed minor bug with DeviantartRipper 2018-07-09 11:38:14 -04:00
cyian-1756
13dd2694b4 Fixed multipart file downloading 2018-07-09 11:19:15 -04:00
cyian-1756
ea00d90a07 1.7.58: Fixed Deviantart ripper; fixed HitomiRipper; Fixed ManganeloRipper; Fixed update box formating 2018-07-08 07:05:46 -04:00
cyian-1756
2629d7ff00
Merge pull request #786 from cyian-1756/manganeloRipperFixes
Manganelo ripper fixes
2018-07-08 06:56:04 -04:00
cyian-1756
474252a7cb Fixed update box formating 2018-07-08 06:44:09 -04:00
cyian-1756
265e131045 Fixed ManganeloRipper 2018-07-08 06:17:51 -04:00
cyian-1756
66f354a046
Merge pull request #780 from cyian-1756/deviantartGalleryFixes
deviantart ripper fixes
2018-07-07 17:37:42 -04:00
cyian-1756
871e8984d8 Added getAlbumTitle for HitomiRipper 2018-07-07 04:03:59 -04:00
cyian-1756
c8e8139cf6 fixed HitomiRipper 2018-07-06 02:11:43 -04:00
cyian-1756
07670c98f8 Fixed Deviantart getUsernameFromURL 2018-07-06 01:32:28 -04:00
cyian-1756
e8f91d1794 DA ripper fixes 2018-07-05 04:35:03 -04:00
cyian-1756
9a29448e73 1.7.57: Got DeviantartRipper working again; Imagefap ripper now downloads full sized images; Twitter ripper can now rip extended tweets; Added nl_NL translation 2018-07-04 00:36:36 -04:00
cyian-1756
6ac6449815 Twitter ripper no longer rips retweets by default 2018-07-04 00:10:30 -04:00
cyian-1756
7f118c6164
Merge pull request #764 from rephormat/xhamsterPretty
Xhamster Descriptive Folder Naming
2018-07-04 00:07:04 -04:00
cyian-1756
e2cc147a96
Merge pull request #766 from cyian-1756/nl_NLTranslation
Added nl_NL translation
2018-07-04 00:06:07 -04:00
cyian-1756
c3b506e7ca Added nl_NL translation 2018-07-03 03:57:32 -04:00
cyian-1756
4b7bd12313 Uncommented out some code 2018-07-03 03:52:53 -04:00
cyian-1756
7eeb6b8378
Merge pull request #760 from cyian-1756/imageFapFix
Imagefap ripper now downloads full sized images
2018-07-03 02:25:39 -04:00
cyian-1756
c0a34fe7a1
Merge pull request #761 from cyian-1756/videoRipperPorts
Xvideo ripper now uses AbstractHTMLRipper
2018-07-03 02:24:51 -04:00
rephormat
aac4fa48f5 Use descriptive naming when Save album titles option is enabled. Format is xhamster_<user>_<gallery url>. 2018-07-02 19:49:47 -05:00
Jicksaw
31482fa0d8
Use paremeter tweet_mode=extended 2018-07-03 01:21:50 +03:00
cyian-1756
55c782dbab Imagefap ripper now downloads full sized images 2018-07-01 22:45:35 -04:00
cyian-1756
7581d5d366 Xvideo ripper now uses AbstractHTMLRipper 2018-07-01 22:26:12 -04:00
cyian-1756
de0dda0d9f Added ripper for loveroms.com 2018-07-01 21:49:00 -04:00
cyian-1756
d0960fad75 Added better url sanitization for DeviantartRipper and some unit tests 2018-07-01 19:25:32 -04:00
cyian-1756
0ed2a7ddac DeviantartRipper can now rip nsfw images 2018-07-01 16:42:11 -04:00
cyian-1756
ae6d09c6e8 Added some unit tests for DeviantartRipper 2018-07-01 15:14:09 -04:00
cyian-1756
dab771f2da Got DeviantartRipper working again 2018-07-01 14:55:48 -04:00
cyian-1756
ef207890fc 1.7.56: Fixed DeviantartRipper ripper; Added support for resuming file downloads; Fixed erome ripper; Fixed ModelmayhemRipper NSFW image downloading 2018-06-30 18:35:13 -04:00
cyian-1756
3136f7bcdf
Merge pull request #754 from cyian-1756/daNewProfileUrl
Fixed  DeviantartRipper ripper
2018-06-30 18:21:40 -04:00
cyian-1756
17a3e4eb50 DeviantartRipper can now rip more than one page again 2018-06-29 21:09:06 -04:00
cyian-1756
e83032906d Started work on fixing da ripper 2018-06-28 21:04:05 -04:00
cyian-1756
f698bdacde
Merge pull request #746 from cyian-1756/byteProgressBar
All rippers can now use a byte progress bar, added the ability to resume some file downloads
2018-06-28 06:52:06 -04:00
cyian-1756
c4588a03a6
Merge pull request #742 from cyian-1756/modelmayhemNSFWFix
ModelmayhemRipper can now donwload nsfw images again
2018-06-28 06:47:48 -04:00
cyian-1756
ffbda6032d Fixed bug that caused downloads from sites that support download resuming to fail with 'Server doesn't support resuming downloads' 2018-06-27 02:05:36 -04:00
cyian-1756
af064ee435 Minor code refactoring 2018-06-27 01:25:58 -04:00
cyian-1756
1f8e9184c7 Added the helper func getByteStatusText to cut down on copy pasted code 2018-06-27 01:24:04 -04:00
cyian-1756
ed7df108e5 Minor code style clean up 2018-06-27 01:02:23 -04:00
cyian-1756
04ca5a2054 Added support for resuming downloads 2018-06-27 00:51:28 -04:00
cyian-1756
b1718965c5 Removed ripper for dead site 2018-06-26 05:12:48 -04:00
cyian-1756
e1635f39e1 GfycatRipper now uses AbstractHTMLRipper 2018-06-26 02:28:14 -04:00
cyian-1756
9b70350b33 GfycatporntubeRipper now uses byte progess bar 2018-06-26 01:36:23 -04:00
cyian-1756
96a8801c19 Rippers can now choose to use a byte progess bar 2018-06-26 00:54:18 -04:00
cyian-1756
c4f2d52370 Fixed erome ripper and added quickQueue support 2018-06-25 05:32:37 -04:00
cyian-1756
5dabdd16ed ModelmayhemRipper can now donwload nsfw images again 2018-06-25 04:43:12 -04:00
cyian-1756
bbef5ed76e Added flag for appending a string to folder name 2018-06-24 03:05:22 -04:00
cyian-1756
a855957ab1 1.7.55: Fixed instagram ripper; Reddit ripper now respects history.end_rip_after_already_seen; Improvements to patch.py and release.py 2018-06-23 19:03:46 -04:00
cyian-1756
90171bfbd9
Merge pull request #727 from cyian-1756/redditHIstoryFix
Reddit history fix
2018-06-23 15:26:31 -04:00
cyian-1756
08c11fa122 Instagram ripper can now get query hash again 2018-06-23 15:10:15 -04:00
cyian-1756
f5bdada31b Reddit ripper now respects history.end_rip_after_already_seen 2018-06-22 17:04:28 -04:00
cyian-1756
0918ab4616 now uses DOWNLOAD_COMPLETE_HISTORY when sending a message about the rip ending due to history.end_rip_after_already_seen config setting 2018-06-22 17:04:01 -04:00
cyian-1756
68b13cbbad Added a rip method status for when a download completes due to the history.end_rip_after_already_seen config setting 2018-06-22 17:03:04 -04:00
Mateus B. Cassiano
c549010c6a Added ArtStation ripper 2018-06-20 18:47:44 -04:00
cyian-1756
c445ab422f 1.7.54: Fixed twitter ripper video downloading; fixed instagram ripper 2018-06-19 16:29:48 -04:00
cyian-1756
a3dd967a5e
Merge pull request #717 from cyian-1756/twitterFix
Twitter ripper no longer errors out on some videos
2018-06-19 16:28:55 -04:00
cyian-1756
ae7c75f98b
Merge pull request #719 from cyian-1756/igFix
Got InstagramRipper working again
2018-06-19 16:28:18 -04:00
cyian-1756
98d4c57f93 Fixed ripping from single instagram page 2018-06-19 16:22:22 -04:00
cyian-1756
867af57713 Got InstagramRipper working again 2018-06-19 16:06:39 -04:00
cyian-1756
16cfe8a9dd AbstractJSONRipper now respects hasASAPRipping 2018-06-19 16:06:19 -04:00
cyian-1756
53684ca169 1.7.53: Added Picstatio ripper; Fixed instagram ripper; Reddit ripper now gets videos from v.redd.it; Fixed ZikiRipper getAlbumTitle; fixed twitter ripper 2018-06-18 21:00:52 -04:00
cyian-1756
0daec636b4
Merge pull request #716 from cyian-1756/igFix
Fixed instagram ripper
2018-06-18 20:48:56 -04:00
cyian-1756
08f4c3eb6c
Merge pull request #714 from cyian-1756/picstatioRipper
Picstatio ripper
2018-06-18 20:41:24 -04:00
cyian-1756
d0b61d8fb3 Fixed instagram ripper 2018-06-18 20:36:06 -04:00
cyian-1756
f34b1273f5 Got PicstatioRipper working 2018-06-18 11:29:10 -04:00
cyian-1756
3ebb7d1874 Started work on Picstatio ripper 2018-06-17 15:55:57 -04:00
cyian-1756
8f20cbbcf2
Merge pull request #700 from cyian-1756/zikiTitleFix
Fixed ZikiRipper getAlbumTitle
2018-06-16 15:42:05 -04:00
cyian-1756
aaaa75b134
Merge pull request #702 from cyian-1756/redditVideoFix
Reddit ripper can now rip videos from v.redd.it
2018-06-16 15:41:30 -04:00
cyian-1756
21a1af7d31 Twitter ripper no longer errors out on some videos 2018-06-16 12:37:31 -04:00
cyian-1756
c4d6f6d9fd twitter ripper now prfixes filenames 2018-06-16 12:29:27 -04:00
cyian-1756
ab4fb97eac Twitter ripper now get retweets when ripping a profile and gets largest video when downloading a video 2018-06-16 12:18:42 -04:00
cyian-1756
c2938af568 Reddit ripper can now rip videos from v.redd.it 2018-06-15 22:23:29 -04:00
cyian-1756
5cfd2d7b6a Fixed ZikiRipper getAlbumTitle 2018-06-15 16:45:45 -04:00
cyian-1756
6cae35ccfb 1.7.52: Added warning about using furaffinty shared account; Refactoring in Utils class; XhamsterRipper now accepts all countries subdomains; E621 ripper now accepts urls with order:Score at the end; release.py imrpovements; DeviantartRipper now logs in using cookies; patch.py imrpovements 2018-06-15 16:23:10 -04:00
cyian-1756
a8dd989d37 Furaffinity ripper now uses RipUtils.getCookiesFromString to get cookies from config file 2018-06-15 16:03:02 -04:00
cyian-1756
a1996cc01e
Merge pull request #695 from Gaboso/master
Refactoring in Utils class
2018-06-15 15:49:16 -04:00
cyian-1756
57f3133b49
Merge pull request #684 from cyian-1756/da
DeviantartRipper now logs in using cookies
2018-06-15 15:48:27 -04:00
cyian-1756
d1a6542912
Merge pull request #681 from cyian-1756/FACookieFix
Users can now use their own account when ripping Furaffinity
2018-06-15 15:14:36 -04:00
cyian-1756
79aaabf580 Removed unneeded logging line 2018-06-15 15:13:13 -04:00
cyian-1756
55e22e7d14
Merge pull request #694 from cyian-1756/xhamsterSubdomainFixes
XhamsterRipper now accepts all countries subdomains
2018-06-15 15:06:09 -04:00
cyian-1756
fa3d149bd2
Merge pull request #693 from cyian-1756/e621UrlRegexFix
E621 ripper now accepts urls with order:Score at the end
2018-06-15 15:05:14 -04:00
cyian-1756
1d71b04533
Merge pull request #690 from cyian-1756/tumblrFixes
Tumblr ripper no longer tries to download images in fullsize if the image doesn't support it
2018-06-15 15:04:25 -04:00
Gaboso
416972ca7b Refactoring in Utils class 2018-06-14 23:08:29 -04:00
cyian-1756
d7f39d9f9b Fixed regression with xhamster ripper that causes it to not accept links to the english version of xhamster.com 2018-06-14 22:23:27 -04:00
cyian-1756
e6f3067015 XhamsterRipper now accepts all countries subdomains 2018-06-14 22:18:17 -04:00
cyian-1756
135e55fb0e E621 ripper now accepts urls with order:Score at the end 2018-06-14 20:25:23 -04:00
cyian-1756
529347a553 Tumblr ripper no longer tries to download images in fullsize if the image doesn't support it 2018-06-12 16:26:23 -04:00
cyian-1756
00f1b8a5e9 FurAffinityRipper now downloads fullsized images and NSFW images 2018-06-11 08:31:47 -04:00
cyian-1756
312e7e5c33 DeviantartRipper now logs in using cookies 2018-06-10 12:12:51 -04:00
cyian-1756
2c5a9fdac3 Added getCookiesFromString func to turn a cookie string into a hashMap 2018-06-10 12:12:29 -04:00
cyian-1756
8df9c70d6c Fixed failing tests on chanripper 2018-06-09 15:12:39 -04:00
cyian-1756
c77593570b Started work on getting DA login working again 2018-06-09 15:05:21 -04:00
Kevin Jiang
b12821f8cc
Merge pull request #668 from cyian-1756/4chanNewDomain
4chan new domain

Failed test due to that page not existing anymore. Should remove test/update it.
2018-06-09 13:32:28 -04:00
cyian-1756
a753b016f6 Ripme now warns users about using the shared Furaffinity account 2018-06-09 03:01:32 -04:00
cyian-1756
cbd1372ba4 Readded shared account cookies; added option to not login to Furaffinity when ripping 2018-06-09 02:46:46 -04:00
Kevin Jiang
8c82588258 VSCO User Profile Fix
Changed the regex slightly to include the "-" character.
2018-06-09 00:19:42 -04:00
cyian-1756
1b5b58ebb4 Removed shared account due to privacy concerns 2018-06-08 16:52:33 -04:00
cyian-1756
9531f44583 1.7.51: Fixed instagram ripper; Added the ability to rip from vsco profiles; Fixed TheyiffgalleryRipper; Can now update ripme using the -j flag; added script to automate releases; Code style fixes 2018-06-07 07:10:14 -04:00
cyian-1756
d51f307212
Merge pull request #669 from cyian-1756/instagramFixes
Fixed instagram ripper
2018-06-07 06:56:32 -04:00
cyian-1756
dad016e5be Readded support desuchan.net 2018-06-07 05:08:09 -04:00
cyian-1756
64ade8a9e0 Fixed instagram ripper 2018-06-07 04:57:03 -04:00
cyian-1756
8ea588a4a5 Added support for new 4chan cdn domain 2018-06-06 11:35:39 -04:00
cyian-1756
b7c4a25f7e Removed questionable code which caused ripme to assume all sites with '/thread/ and '/res/' in the url are chans 2018-06-06 11:34:16 -04:00
Gaboso
bc63f14fd3 Changed logger to LOGGER 2018-06-04 22:58:14 -04:00
Gaboso
ccaa2edeb0 Merge branch 'master' of https://github.com/RipMeApp/ripme into logger
# Conflicts:
#	src/main/java/com/rarchives/ripme/ripper/VideoRipper.java
#	src/main/java/com/rarchives/ripme/ripper/rippers/VscoRipper.java
2018-06-04 22:36:14 -04:00
Kevin Jiang
35aa8e0129
Merge pull request #658 from Gaboso/master
Updating the VideoRipper class
2018-06-03 16:45:53 -04:00
Kevin Jiang
53b22f8535
Merge pull request #656 from cyian-1756/updateImprovements
Various update improvements
2018-06-03 16:42:27 -04:00
Gaboso
3c3aa02290 Changed logger to LOGGER 2018-06-02 21:14:41 -04:00
Gaboso
7f4df8b567 Updating the VideoRipper class:
- ordered imports alphabetically;
- removed signature of the canRip method, which is already in AbstractRipper;
- split variable declaration in different lines;
- corrected javadocs alignment;
- replaced unnecessary use of StringBuilder.
- added a few empty lines to increase the readability of the code
2018-06-02 20:49:35 -04:00
cyian-1756
416e5817e8 Added the ability to rip from vsco profiles 2018-06-02 18:40:52 -04:00
cyian-1756
9af46aad20 Ripme now logs when it's forcing an update for testing 2018-06-02 16:14:48 -04:00
cyian-1756
1adc0a9bf7 Added config option to make ripme always try to update (for testing purposes) 2018-06-02 16:08:49 -04:00
cyian-1756
b0bcf506aa Can now disable the update hash check 2018-06-02 16:02:52 -04:00
Kevin Jiang
a02933f0d2
Merge pull request #643 from Gaboso/master
Replaced the if-else statement by a single return statement.

Thanks for all these style changes
2018-06-02 15:47:25 -04:00
Kevin Jiang
90b2ef7edd
Merge pull request #646 from cyian-1756/Aerisdies
Fixed Aerisdies ripper
2018-06-02 15:46:14 -04:00
Kevin Jiang
b965074c49
Merge pull request #654 from cyian-1756/theyiffgalleryRipperFix
Fixed TheyiffgalleryRipper
2018-06-02 15:45:23 -04:00
cyian-1756
10d256a6e5 Cut down on repeated code 2018-06-02 15:39:27 -04:00
cyian-1756
5cbc152e1c Change log is now displayed when updating from command line 2018-06-02 15:32:21 -04:00
Gaboso
3529d679ff Merge branch 'master' of https://github.com/RipMeApp/ripme 2018-06-02 09:51:17 -04:00
Kevin Jiang
371ce56952
Merge pull request #651 from cyian-1756/commandLineUpdate
Failed test unrelated.
2018-06-01 19:30:21 -04:00
cyian-1756
5f90a1792e Fixed TheyiffgalleryRipper 2018-06-01 18:41:19 -04:00
cyian-1756
2bb7508e9b Undid DEFAULT_VERSION change 2018-06-01 18:17:33 -04:00
cyian-1756
7dc8b23aae Can now update ripme using the -j flag 2018-06-01 16:01:13 -04:00
cyian-1756
30a2d015aa Added -j flag for updating ripme 2018-06-01 16:00:32 -04:00
cyian-1756
5a918ba7ae Fixed getAlbumTitle 2018-05-31 21:21:30 -04:00
cyian-1756
9a8888d445 Ripper now can download videos again and no longer uses the same api key every time 2018-05-31 16:42:06 -04:00
Gaboso
5c6b68a428 Replaced the if-else statement by a single return statement.
Replaced use of Collection.size () by Collection.isEmpty () in ViddmeRipper.
2018-05-31 09:21:44 -04:00
cyian-1756
6fde66cd4d 1.7.50: Ripme now checks file hash before running update; fixed update bug which cased ripme to report every update as new 2018-05-30 15:31:04 -04:00
cyian-1756
17f3882057 Ripme now checks file hash before running update; fixed update bug which cased ripme to report every update as new 2018-05-30 15:07:00 -04:00
cyian-1756
a3dba215f4
Merge pull request #635 from Gaboso/master
Replaced use of Collection.size () by Collection.isEmpty ()
2018-05-30 00:04:19 -04:00
cyian-1756
ce8c9aa2e3
Merge pull request #622 from bored/no-prop-file
Reverse -n, --no-prop-file behaviour
2018-05-29 23:49:33 -04:00
cyian-1756
4d54f4731d
Merge pull request #623 from torbica/master
Fix history again
2018-05-29 23:49:24 -04:00
cyian-1756
ed30482123
Merge pull request #625 from cyian-1756/refactoring
Some UI refactoring
2018-05-29 23:49:11 -04:00
cyian-1756
c6b22b25df
Merge pull request #629 from cyian-1756/updateImprovements
Update improvements
2018-05-29 23:48:12 -04:00
cyian-1756
e9b2baa873
Merge pull request #632 from cyian-1756/saveUrlsOnlyFix
No longer writes url to url_history file is save urls only is checked
2018-05-29 23:47:47 -04:00
Gaboso
6c39dec9d5 Merge branch 'master' of https://github.com/RipMeApp/ripme 2018-05-29 22:49:54 -04:00
Gaboso
fa8f7b5c00 Replaced use of Collection.size () by Collection.isEmpty () which makes the code more readable and may have more performance 2018-05-29 22:48:44 -04:00
cyian-1756
d16b997094 Removed support for tnbtu.com as it is no longer a wordpress comic site 2018-05-29 21:25:53 -04:00