Commit Graph

1516 Commits

Author SHA1 Message Date
cyian-1756
b7f8b0edf6
Merge pull request #856 from cyian-1756/hitomiRipperFixes
Fixed HitomiRipper
2018-08-07 14:05:25 -04:00
Israel Vargas Merljak
61bd99cae9
pt_BR translation added
Altered .gitignore to negate *.properties rule for the i18n bundle resources. (why are the .properties files being ignored anyway?)
2018-08-07 09:35:24 -03:00
cyian-1756
24a0228885 Fixed HitomiRipper 2018-08-06 18:42:32 -04:00
cyian-1756
09abf5ab6c Added unittest for Hentaiimage Ripper 2018-08-06 14:30:31 -04:00
cyian-1756
49b8471f41 Added support for hentai-comic.com 2018-08-05 20:04:39 -04:00
cyian-1756
489694a9d3 Added support for hentai-image.com 2018-08-05 19:35:12 -04:00
cyian-1756
2d4dd89bfc 1.7.61: Re-add 8Chan support; Added kenzato.uk to CheveretoRippers; Added russian translation; Reddit ripper now uses sub folders; fixed JabArchivesRipper regex 2018-08-04 13:31:46 -04:00
cyian-1756
7674eb570e
Merge pull request #830 from cyian-1756/moreMagicNumbers
Changed how magic number look ups are done (now uses a hash map); add…
2018-08-04 13:11:03 -04:00
cyian-1756
e56d47964d
Merge pull request #854 from cyian-1756/jabRegexFix
JabArchivesRipper now allows for www. to appear in url
2018-08-04 13:09:54 -04:00
cyian-1756
2f131ef51a
Merge pull request #847 from kevin51jiang/master
Re-recognize 8Chan URLs
2018-08-04 13:03:40 -04:00
cyian-1756
559e0860dd
Merge pull request #839 from jooxxxoooo/imgurAlbums
Added possibility to save reddit posts with multiple images in separat…
2018-08-04 13:00:28 -04:00
cyian-1756
292e977a22
Merge branch 'master' into moreMagicNumbers 2018-08-04 12:52:25 -04:00
cyian-1756
0dc648beb3 Tweaked regex a bit more 2018-08-04 12:45:35 -04:00
cyian-1756
2f45dc9211 Tweaked regex a bit more 2018-08-04 10:29:28 -04:00
cyian-1756
f38bb7ba9b JabArchivesRipper now allows for www. to appear in url 2018-08-03 20:59:50 -04:00
Kevin Jiang
6e26ba3e0b Re-add 8Chan support 2018-08-01 04:45:44 -04:00
cyian-1756
d71addb8a7 improved logging message and added comment for timeouts 2018-07-31 16:55:21 -04:00
cyian-1756
77a64a1dd7 Timeout now applies to both connection and read 2018-07-31 16:50:19 -04:00
cyian-1756
15c4b245fb
Merge pull request #837 from cyian-1756/codeDeduping
Added an Abstraction for rippers that only ever download a single file and want to use the bytes progress bar
2018-07-31 08:38:30 -04:00
cyian-1756
bf4553885a
Merge pull request #831 from cyian-1756/moreUtilsUnitTests
Added some more unit tests
2018-07-31 08:37:17 -04:00
cyian-1756
036ec91b43
Merge pull request #840 from cyian-1756/Chevereto
Added kenzato.uk to CheveretoRippers
2018-07-31 08:35:56 -04:00
cyian-1756
93b3f99069
Merge pull request #841 from cyian-1756/todoFixes
Removed outdated todo
2018-07-31 08:32:43 -04:00
cyian-1756
771159de56 Removed outdated todo 2018-07-29 10:48:46 -04:00
cyian-1756
7196c59453 Added unit test for kenzato.uk 2018-07-29 10:40:22 -04:00
cyian-1756
0a0b6d299a Added kenzato.uk to CheveretoRippers 2018-07-29 10:37:15 -04:00
Johannes Drescher
407564feee Added possibility to save reddit post with multiple images in separate subdirectory with title name.
Added title to the saved filename when only one image/video.
2018-07-29 16:12:23 +02:00
cyian-1756
596be7b839 Added an Abstraction for rippers that only ever download a single file and want to use the bytes progress bar 2018-07-26 11:09:04 -04:00
cyian-1756
544e95757f
Merge pull request #832 from cyian-1756/russianTranslation
Added russian translation
2018-07-26 10:52:41 -04:00
cyian-1756
a3678561c3 Removed failing unit test 2018-07-25 21:32:29 -04:00
cyian-1756
7a86e10f49 Added russian translation 2018-07-25 21:29:43 -04:00
cyian-1756
92005bfb31 Added russian translation 2018-07-25 08:51:04 -04:00
cyian-1756
c83d93a2e3 Added some more unit tests 2018-07-25 03:42:50 -04:00
cyian-1756
abeb0b0984 Changed how magic number look ups are done (now uses a hash map); added magic number for png; added unit test 2018-07-25 03:16:41 -04:00
cyian-1756
24b1c7175e 1.7.60: Fixed EightmusesRipper; added Jab Archives ripper; loveroms ripper now properly names files; Fixed ArtStationRipper 2018-07-25 00:28:39 -04:00
cyian-1756
316a07cf77
Merge pull request #823 from cyian-1756/magicNumbers
Can now get file type from magic number; No longer erroneously redownloads file if getFileExtFromMIME is true
2018-07-25 00:22:05 -04:00
cyian-1756
fb329d26ce
Merge pull request #829 from cyian-1756/8musesFixes
Fixed EightmusesRipper
2018-07-25 00:16:32 -04:00
cyian-1756
0f3148f47f Removed some debugging statments 2018-07-25 00:03:28 -04:00
cyian-1756
af33869e52 Fixed EightmusesRipper 2018-07-24 23:49:53 -04:00
cyian-1756
58cdea1ee2 Added some unit tests 2018-07-23 05:02:25 -04:00
cyian-1756
cb1fec52f5 saveAs.exists() imrpovements 2018-07-23 03:12:03 -04:00
cyian-1756
1d60bf6956 Added a fuzzyExist func to check if a file exist when we don't know it's extension (For use with rippers that use getFileExtFromMIME) 2018-07-22 19:31:11 -04:00
cyian-1756
368646145d Can now get file type from magic number 2018-07-22 19:02:06 -04:00
cyian-1756
e67612993a
Merge pull request #812 from 0x1f595/jabarchives
Adding Jab Archives ripper
2018-07-21 17:17:03 -04:00
cyian-1756
e0c9822331
Merge pull request #813 from cyian-1756/loveromRipper
loveroms ripper now properly names files
2018-07-21 16:54:12 -04:00
cyian-1756
f3fe3ebebd
Merge pull request #816 from mbc07/ArtStation_multi_page_fix
ArtStationRipper: fix ripping from user profiles which many projects
2018-07-21 16:52:25 -04:00
cyian-1756
0324c94961
Merge pull request #814 from cyian-1756/redditImgurGifv
getFilesFromURL now handles imgur gifvs
2018-07-21 16:43:59 -04:00
Samuel P. Bowman
55a76ba7e1 fixed issues with prior fix 2018-07-19 09:51:13 -04:00
cyian-1756
0c4ec95ca4 Fixed xhamster getNextPage 2018-07-19 00:21:39 -04:00
Mateus B. Cassiano
9bb28cf4c7 ArtStationRipper: update unit test 2018-07-16 02:09:06 -04:00
Mateus B. Cassiano
47cab78843 ArtStationRipper: fix ripping from user pages with more than 50 projects 2018-07-16 02:08:03 -04:00
cyian-1756
726e303a08 improved how riputils gets imgur mp4s 2018-07-15 15:03:56 -04:00
cyian-1756
3f7b6711e3 getFilesFromURL now handles imgur gifvs 2018-07-15 14:39:14 -04:00
cyian-1756
1cf4aba2ab loveroms ripper now properly names files 2018-07-15 14:24:26 -04:00
0x1f595
daae074713 Use SSL by default on Jav Archives 2018-07-14 13:10:53 -06:00
0x1f595
27530965c2 Merge remote-tracking branch 'upstream/master' 2018-07-14 13:07:48 -06:00
0x1f595
7cf3a01379 Adding Jab Archives ripper
This currently only supports ripping bottom-level folders. If a folder you rip contains another folder, that subfolder will not be fully ripped, only the source image from its thumbnail will be included in the rip.
2018-07-14 13:06:29 -06:00
cyian-1756
cbfd363842 1.7.59: Added Loverom ripper; added Imagearn ripper; Added support for Desuarchive.org; Fixed erome ripper 2018-07-14 14:56:45 -04:00
cyian-1756
26288a5cb4
Merge pull request #800 from cyian-1756/desuarchive
Added support for Desuarchive.org
2018-07-14 14:49:26 -04:00
cyian-1756
1f9e5506ff
Merge pull request #806 from cyian-1756/manganeloFixes
Fixed ManganeloRipper
2018-07-14 14:48:56 -04:00
cyian-1756
4074fcc448
Merge pull request #807 from cyian-1756/eromeVideos
Fixed erome video downloading
2018-07-14 14:48:43 -04:00
cyian-1756
0bf6381ede
Merge pull request #809 from cyian-1756/imagearn
Readded Imagearn ripper and test
2018-07-14 14:48:18 -04:00
cyian-1756
6cdf918ada
Merge pull request #788 from cyian-1756/loveromRipper
Loverom ripper [WIP]
2018-07-14 14:47:44 -04:00
cyian-1756
3f18d8a990 Readded Imagearn ripper and test 2018-07-13 20:06:54 -04:00
cyian-1756
3287b8c59a Fixed erome video downloading 2018-07-13 19:01:55 -04:00
cyian-1756
a65ad6f756 Fixed ManganeloRipper 2018-07-13 18:14:36 -04:00
Samuel P. Bowman
5622d55c3e Fix Issue 789: Implemented wraparound in log window and status label. 2018-07-13 13:19:54 -04:00
cyian-1756
3553118b54 Added support for Desuarchive.org 2018-07-12 13:44:45 -04:00
cyian-1756
35d24d22a5
Merge pull request #796 from cyian-1756/cli_crash_fix
No longer tries to send download compete message every time ripme sav…
2018-07-11 13:54:33 -04:00
cyian-1756
f7a1255bab Added loverom unit test 2018-07-11 13:52:29 -04:00
cyian-1756
96738883b0
Merge pull request #791 from cyian-1756/deviantartGalleryFixes
Fixed minor bug with DeviantartRipper
2018-07-11 13:43:47 -04:00
cyian-1756
fc52da3497 No longer tries to send download compete message every time ripme saves a url to a text file 2018-07-11 13:40:09 -04:00
cyian-1756
67e2451744 Now properly names multi-part files; Updated to work with recent changes to site 2018-07-10 13:24:56 -04:00
cyian-1756
59dd904c22 Now prints error when ripme can't get a files type from the stream 2018-07-10 12:53:02 -04:00
cyian-1756
6c64f73daa Fixed minor bug with DeviantartRipper 2018-07-09 11:38:14 -04:00
cyian-1756
13dd2694b4 Fixed multipart file downloading 2018-07-09 11:19:15 -04:00
cyian-1756
ea00d90a07 1.7.58: Fixed Deviantart ripper; fixed HitomiRipper; Fixed ManganeloRipper; Fixed update box formating 2018-07-08 07:05:46 -04:00
cyian-1756
2629d7ff00
Merge pull request #786 from cyian-1756/manganeloRipperFixes
Manganelo ripper fixes
2018-07-08 06:56:04 -04:00
cyian-1756
474252a7cb Fixed update box formating 2018-07-08 06:44:09 -04:00
cyian-1756
42c5a7be3f Changed ManganeloRipper unittest url to a smaller album, added test got getGid 2018-07-08 06:18:23 -04:00
cyian-1756
265e131045 Fixed ManganeloRipper 2018-07-08 06:17:51 -04:00
cyian-1756
66f354a046
Merge pull request #780 from cyian-1756/deviantartGalleryFixes
deviantart ripper fixes
2018-07-07 17:37:42 -04:00
cyian-1756
871e8984d8 Added getAlbumTitle for HitomiRipper 2018-07-07 04:03:59 -04:00
cyian-1756
c8e8139cf6 fixed HitomiRipper 2018-07-06 02:11:43 -04:00
cyian-1756
07670c98f8 Fixed Deviantart getUsernameFromURL 2018-07-06 01:32:28 -04:00
cyian-1756
e8f91d1794 DA ripper fixes 2018-07-05 04:35:03 -04:00
cyian-1756
9a29448e73 1.7.57: Got DeviantartRipper working again; Imagefap ripper now downloads full sized images; Twitter ripper can now rip extended tweets; Added nl_NL translation 2018-07-04 00:36:36 -04:00
cyian-1756
6ac6449815 Twitter ripper no longer rips retweets by default 2018-07-04 00:10:30 -04:00
cyian-1756
7f118c6164
Merge pull request #764 from rephormat/xhamsterPretty
Xhamster Descriptive Folder Naming
2018-07-04 00:07:04 -04:00
cyian-1756
e2cc147a96
Merge pull request #766 from cyian-1756/nl_NLTranslation
Added nl_NL translation
2018-07-04 00:06:07 -04:00
cyian-1756
c3b506e7ca Added nl_NL translation 2018-07-03 03:57:32 -04:00
cyian-1756
4b7bd12313 Uncommented out some code 2018-07-03 03:52:53 -04:00
cyian-1756
7eeb6b8378
Merge pull request #760 from cyian-1756/imageFapFix
Imagefap ripper now downloads full sized images
2018-07-03 02:25:39 -04:00
cyian-1756
c0a34fe7a1
Merge pull request #761 from cyian-1756/videoRipperPorts
Xvideo ripper now uses AbstractHTMLRipper
2018-07-03 02:24:51 -04:00
rephormat
aac4fa48f5 Use descriptive naming when Save album titles option is enabled. Format is xhamster_<user>_<gallery url>. 2018-07-02 19:49:47 -05:00
Jicksaw
31482fa0d8
Use paremeter tweet_mode=extended 2018-07-03 01:21:50 +03:00
cyian-1756
55c782dbab Imagefap ripper now downloads full sized images 2018-07-01 22:45:35 -04:00
cyian-1756
f6bb268b4c Added a unittest for the XvideosRipper 2018-07-01 22:32:44 -04:00
cyian-1756
7581d5d366 Xvideo ripper now uses AbstractHTMLRipper 2018-07-01 22:26:12 -04:00
cyian-1756
de0dda0d9f Added ripper for loveroms.com 2018-07-01 21:49:00 -04:00
cyian-1756
d0960fad75 Added better url sanitization for DeviantartRipper and some unit tests 2018-07-01 19:25:32 -04:00
cyian-1756
0ed2a7ddac DeviantartRipper can now rip nsfw images 2018-07-01 16:42:11 -04:00
cyian-1756
ae6d09c6e8 Added some unit tests for DeviantartRipper 2018-07-01 15:14:09 -04:00
cyian-1756
dab771f2da Got DeviantartRipper working again 2018-07-01 14:55:48 -04:00
cyian-1756
ef207890fc 1.7.56: Fixed DeviantartRipper ripper; Added support for resuming file downloads; Fixed erome ripper; Fixed ModelmayhemRipper NSFW image downloading 2018-06-30 18:35:13 -04:00
cyian-1756
3136f7bcdf
Merge pull request #754 from cyian-1756/daNewProfileUrl
Fixed  DeviantartRipper ripper
2018-06-30 18:21:40 -04:00
cyian-1756
c6aa3a2af9 Fixed DeviantartRipper unit tests 2018-06-29 23:04:13 -04:00
cyian-1756
17a3e4eb50 DeviantartRipper can now rip more than one page again 2018-06-29 21:09:06 -04:00
cyian-1756
e83032906d Started work on fixing da ripper 2018-06-28 21:04:05 -04:00
cyian-1756
f698bdacde
Merge pull request #746 from cyian-1756/byteProgressBar
All rippers can now use a byte progress bar, added the ability to resume some file downloads
2018-06-28 06:52:06 -04:00
cyian-1756
c4588a03a6
Merge pull request #742 from cyian-1756/modelmayhemNSFWFix
ModelmayhemRipper can now donwload nsfw images again
2018-06-28 06:47:48 -04:00
cyian-1756
ffbda6032d Fixed bug that caused downloads from sites that support download resuming to fail with 'Server doesn't support resuming downloads' 2018-06-27 02:05:36 -04:00
cyian-1756
af064ee435 Minor code refactoring 2018-06-27 01:25:58 -04:00
cyian-1756
1f8e9184c7 Added the helper func getByteStatusText to cut down on copy pasted code 2018-06-27 01:24:04 -04:00
cyian-1756
ed7df108e5 Minor code style clean up 2018-06-27 01:02:23 -04:00
cyian-1756
2c08be83f6 Removed unit test for vine ripper has the ripper was removed 2018-06-27 00:58:55 -04:00
cyian-1756
04ca5a2054 Added support for resuming downloads 2018-06-27 00:51:28 -04:00
cyian-1756
b1718965c5 Removed ripper for dead site 2018-06-26 05:12:48 -04:00
cyian-1756
1428b2cd6b Fixed some unit tests that broke when the GfycatRipper was moved 2018-06-26 02:49:18 -04:00
cyian-1756
e1635f39e1 GfycatRipper now uses AbstractHTMLRipper 2018-06-26 02:28:14 -04:00
cyian-1756
9b70350b33 GfycatporntubeRipper now uses byte progess bar 2018-06-26 01:36:23 -04:00
cyian-1756
96a8801c19 Rippers can now choose to use a byte progess bar 2018-06-26 00:54:18 -04:00
cyian-1756
da198cf021 Added unit test for Myhentaicomics quickQueue 2018-06-25 17:27:32 -04:00
cyian-1756
b63f8f16b9 Added unit test for erome 2018-06-25 06:03:10 -04:00
cyian-1756
c4f2d52370 Fixed erome ripper and added quickQueue support 2018-06-25 05:32:37 -04:00
cyian-1756
5dabdd16ed ModelmayhemRipper can now donwload nsfw images again 2018-06-25 04:43:12 -04:00
cyian-1756
bbef5ed76e Added flag for appending a string to folder name 2018-06-24 03:05:22 -04:00
cyian-1756
a855957ab1 1.7.55: Fixed instagram ripper; Reddit ripper now respects history.end_rip_after_already_seen; Improvements to patch.py and release.py 2018-06-23 19:03:46 -04:00
cyian-1756
90171bfbd9
Merge pull request #727 from cyian-1756/redditHIstoryFix
Reddit history fix
2018-06-23 15:26:31 -04:00
cyian-1756
a0f90e6fd3
Merge pull request #733 from cyian-1756/instagramNextPageFix
Instagram ripper can now get query hash again
2018-06-23 15:25:52 -04:00
cyian-1756
08c11fa122 Instagram ripper can now get query hash again 2018-06-23 15:10:15 -04:00
cyian-1756
f5bdada31b Reddit ripper now respects history.end_rip_after_already_seen 2018-06-22 17:04:28 -04:00
cyian-1756
0918ab4616 now uses DOWNLOAD_COMPLETE_HISTORY when sending a message about the rip ending due to history.end_rip_after_already_seen config setting 2018-06-22 17:04:01 -04:00
cyian-1756
68b13cbbad Added a rip method status for when a download completes due to the history.end_rip_after_already_seen config setting 2018-06-22 17:03:04 -04:00
cyian-1756
9c1c1a6b83 Disabled test for Bcfakes.com as the site has been down for many days 2018-06-21 16:22:00 -04:00
Mateus B. Cassiano
d3dde5eebe Added ArtStationRipper unit test 2018-06-20 18:48:46 -04:00
Mateus B. Cassiano
c549010c6a Added ArtStation ripper 2018-06-20 18:47:44 -04:00
cyian-1756
c445ab422f 1.7.54: Fixed twitter ripper video downloading; fixed instagram ripper 2018-06-19 16:29:48 -04:00
cyian-1756
a3dd967a5e
Merge pull request #717 from cyian-1756/twitterFix
Twitter ripper no longer errors out on some videos
2018-06-19 16:28:55 -04:00
cyian-1756
ae7c75f98b
Merge pull request #719 from cyian-1756/igFix
Got InstagramRipper working again
2018-06-19 16:28:18 -04:00
cyian-1756
98d4c57f93 Fixed ripping from single instagram page 2018-06-19 16:22:22 -04:00
cyian-1756
867af57713 Got InstagramRipper working again 2018-06-19 16:06:39 -04:00
cyian-1756
16cfe8a9dd AbstractJSONRipper now respects hasASAPRipping 2018-06-19 16:06:19 -04:00
cyian-1756
53684ca169 1.7.53: Added Picstatio ripper; Fixed instagram ripper; Reddit ripper now gets videos from v.redd.it; Fixed ZikiRipper getAlbumTitle; fixed twitter ripper 2018-06-18 21:00:52 -04:00
cyian-1756
0daec636b4
Merge pull request #716 from cyian-1756/igFix
Fixed instagram ripper
2018-06-18 20:48:56 -04:00
cyian-1756
08f4c3eb6c
Merge pull request #714 from cyian-1756/picstatioRipper
Picstatio ripper
2018-06-18 20:41:24 -04:00
cyian-1756
d0b61d8fb3 Fixed instagram ripper 2018-06-18 20:36:06 -04:00
cyian-1756
7102bdec6f Added PicstatioRipper unit test 2018-06-18 11:37:24 -04:00
cyian-1756
f34b1273f5 Got PicstatioRipper working 2018-06-18 11:29:10 -04:00
cyian-1756
3ebb7d1874 Started work on Picstatio ripper 2018-06-17 15:55:57 -04:00
cyian-1756
8f20cbbcf2
Merge pull request #700 from cyian-1756/zikiTitleFix
Fixed ZikiRipper getAlbumTitle
2018-06-16 15:42:05 -04:00