Commit Graph

1460 Commits

Author SHA1 Message Date
cyian-1756
2d4dd89bfc 1.7.61: Re-add 8Chan support; Added kenzato.uk to CheveretoRippers; Added russian translation; Reddit ripper now uses sub folders; fixed JabArchivesRipper regex 2018-08-04 13:31:46 -04:00
cyian-1756
7674eb570e
Merge pull request #830 from cyian-1756/moreMagicNumbers
Changed how magic number look ups are done (now uses a hash map); add…
2018-08-04 13:11:03 -04:00
cyian-1756
e56d47964d
Merge pull request #854 from cyian-1756/jabRegexFix
JabArchivesRipper now allows for www. to appear in url
2018-08-04 13:09:54 -04:00
cyian-1756
2f131ef51a
Merge pull request #847 from kevin51jiang/master
Re-recognize 8Chan URLs
2018-08-04 13:03:40 -04:00
cyian-1756
559e0860dd
Merge pull request #839 from jooxxxoooo/imgurAlbums
Added possibility to save reddit posts with multiple images in separat…
2018-08-04 13:00:28 -04:00
cyian-1756
292e977a22
Merge branch 'master' into moreMagicNumbers 2018-08-04 12:52:25 -04:00
cyian-1756
0dc648beb3 Tweaked regex a bit more 2018-08-04 12:45:35 -04:00
cyian-1756
2f45dc9211 Tweaked regex a bit more 2018-08-04 10:29:28 -04:00
cyian-1756
f38bb7ba9b JabArchivesRipper now allows for www. to appear in url 2018-08-03 20:59:50 -04:00
Kevin Jiang
6e26ba3e0b Re-add 8Chan support 2018-08-01 04:45:44 -04:00
cyian-1756
d71addb8a7 improved logging message and added comment for timeouts 2018-07-31 16:55:21 -04:00
cyian-1756
77a64a1dd7 Timeout now applies to both connection and read 2018-07-31 16:50:19 -04:00
cyian-1756
15c4b245fb
Merge pull request #837 from cyian-1756/codeDeduping
Added an Abstraction for rippers that only ever download a single file and want to use the bytes progress bar
2018-07-31 08:38:30 -04:00
cyian-1756
bf4553885a
Merge pull request #831 from cyian-1756/moreUtilsUnitTests
Added some more unit tests
2018-07-31 08:37:17 -04:00
cyian-1756
036ec91b43
Merge pull request #840 from cyian-1756/Chevereto
Added kenzato.uk to CheveretoRippers
2018-07-31 08:35:56 -04:00
cyian-1756
93b3f99069
Merge pull request #841 from cyian-1756/todoFixes
Removed outdated todo
2018-07-31 08:32:43 -04:00
cyian-1756
771159de56 Removed outdated todo 2018-07-29 10:48:46 -04:00
cyian-1756
7196c59453 Added unit test for kenzato.uk 2018-07-29 10:40:22 -04:00
cyian-1756
0a0b6d299a Added kenzato.uk to CheveretoRippers 2018-07-29 10:37:15 -04:00
Johannes Drescher
407564feee Added possibility to save reddit post with multiple images in separate subdirectory with title name.
Added title to the saved filename when only one image/video.
2018-07-29 16:12:23 +02:00
cyian-1756
596be7b839 Added an Abstraction for rippers that only ever download a single file and want to use the bytes progress bar 2018-07-26 11:09:04 -04:00
cyian-1756
544e95757f
Merge pull request #832 from cyian-1756/russianTranslation
Added russian translation
2018-07-26 10:52:41 -04:00
cyian-1756
a3678561c3 Removed failing unit test 2018-07-25 21:32:29 -04:00
cyian-1756
7a86e10f49 Added russian translation 2018-07-25 21:29:43 -04:00
cyian-1756
92005bfb31 Added russian translation 2018-07-25 08:51:04 -04:00
cyian-1756
c83d93a2e3 Added some more unit tests 2018-07-25 03:42:50 -04:00
cyian-1756
abeb0b0984 Changed how magic number look ups are done (now uses a hash map); added magic number for png; added unit test 2018-07-25 03:16:41 -04:00
cyian-1756
24b1c7175e 1.7.60: Fixed EightmusesRipper; added Jab Archives ripper; loveroms ripper now properly names files; Fixed ArtStationRipper 2018-07-25 00:28:39 -04:00
cyian-1756
316a07cf77
Merge pull request #823 from cyian-1756/magicNumbers
Can now get file type from magic number; No longer erroneously redownloads file if getFileExtFromMIME is true
2018-07-25 00:22:05 -04:00
cyian-1756
fb329d26ce
Merge pull request #829 from cyian-1756/8musesFixes
Fixed EightmusesRipper
2018-07-25 00:16:32 -04:00
cyian-1756
0f3148f47f Removed some debugging statments 2018-07-25 00:03:28 -04:00
cyian-1756
af33869e52 Fixed EightmusesRipper 2018-07-24 23:49:53 -04:00
cyian-1756
58cdea1ee2 Added some unit tests 2018-07-23 05:02:25 -04:00
cyian-1756
cb1fec52f5 saveAs.exists() imrpovements 2018-07-23 03:12:03 -04:00
cyian-1756
1d60bf6956 Added a fuzzyExist func to check if a file exist when we don't know it's extension (For use with rippers that use getFileExtFromMIME) 2018-07-22 19:31:11 -04:00
cyian-1756
368646145d Can now get file type from magic number 2018-07-22 19:02:06 -04:00
cyian-1756
e67612993a
Merge pull request #812 from 0x1f595/jabarchives
Adding Jab Archives ripper
2018-07-21 17:17:03 -04:00
cyian-1756
e0c9822331
Merge pull request #813 from cyian-1756/loveromRipper
loveroms ripper now properly names files
2018-07-21 16:54:12 -04:00
cyian-1756
f3fe3ebebd
Merge pull request #816 from mbc07/ArtStation_multi_page_fix
ArtStationRipper: fix ripping from user profiles which many projects
2018-07-21 16:52:25 -04:00
cyian-1756
0324c94961
Merge pull request #814 from cyian-1756/redditImgurGifv
getFilesFromURL now handles imgur gifvs
2018-07-21 16:43:59 -04:00
Samuel P. Bowman
55a76ba7e1 fixed issues with prior fix 2018-07-19 09:51:13 -04:00
cyian-1756
0c4ec95ca4 Fixed xhamster getNextPage 2018-07-19 00:21:39 -04:00
Mateus B. Cassiano
9bb28cf4c7 ArtStationRipper: update unit test 2018-07-16 02:09:06 -04:00
Mateus B. Cassiano
47cab78843 ArtStationRipper: fix ripping from user pages with more than 50 projects 2018-07-16 02:08:03 -04:00
cyian-1756
726e303a08 improved how riputils gets imgur mp4s 2018-07-15 15:03:56 -04:00
cyian-1756
3f7b6711e3 getFilesFromURL now handles imgur gifvs 2018-07-15 14:39:14 -04:00
cyian-1756
1cf4aba2ab loveroms ripper now properly names files 2018-07-15 14:24:26 -04:00
0x1f595
daae074713 Use SSL by default on Jav Archives 2018-07-14 13:10:53 -06:00
0x1f595
27530965c2 Merge remote-tracking branch 'upstream/master' 2018-07-14 13:07:48 -06:00
0x1f595
7cf3a01379 Adding Jab Archives ripper
This currently only supports ripping bottom-level folders. If a folder you rip contains another folder, that subfolder will not be fully ripped, only the source image from its thumbnail will be included in the rip.
2018-07-14 13:06:29 -06:00
cyian-1756
cbfd363842 1.7.59: Added Loverom ripper; added Imagearn ripper; Added support for Desuarchive.org; Fixed erome ripper 2018-07-14 14:56:45 -04:00
cyian-1756
26288a5cb4
Merge pull request #800 from cyian-1756/desuarchive
Added support for Desuarchive.org
2018-07-14 14:49:26 -04:00
cyian-1756
1f9e5506ff
Merge pull request #806 from cyian-1756/manganeloFixes
Fixed ManganeloRipper
2018-07-14 14:48:56 -04:00
cyian-1756
4074fcc448
Merge pull request #807 from cyian-1756/eromeVideos
Fixed erome video downloading
2018-07-14 14:48:43 -04:00
cyian-1756
0bf6381ede
Merge pull request #809 from cyian-1756/imagearn
Readded Imagearn ripper and test
2018-07-14 14:48:18 -04:00
cyian-1756
6cdf918ada
Merge pull request #788 from cyian-1756/loveromRipper
Loverom ripper [WIP]
2018-07-14 14:47:44 -04:00
cyian-1756
3f18d8a990 Readded Imagearn ripper and test 2018-07-13 20:06:54 -04:00
cyian-1756
3287b8c59a Fixed erome video downloading 2018-07-13 19:01:55 -04:00
cyian-1756
a65ad6f756 Fixed ManganeloRipper 2018-07-13 18:14:36 -04:00
Samuel P. Bowman
5622d55c3e Fix Issue 789: Implemented wraparound in log window and status label. 2018-07-13 13:19:54 -04:00
cyian-1756
3553118b54 Added support for Desuarchive.org 2018-07-12 13:44:45 -04:00
cyian-1756
35d24d22a5
Merge pull request #796 from cyian-1756/cli_crash_fix
No longer tries to send download compete message every time ripme sav…
2018-07-11 13:54:33 -04:00
cyian-1756
f7a1255bab Added loverom unit test 2018-07-11 13:52:29 -04:00
cyian-1756
96738883b0
Merge pull request #791 from cyian-1756/deviantartGalleryFixes
Fixed minor bug with DeviantartRipper
2018-07-11 13:43:47 -04:00
cyian-1756
fc52da3497 No longer tries to send download compete message every time ripme saves a url to a text file 2018-07-11 13:40:09 -04:00
cyian-1756
67e2451744 Now properly names multi-part files; Updated to work with recent changes to site 2018-07-10 13:24:56 -04:00
cyian-1756
59dd904c22 Now prints error when ripme can't get a files type from the stream 2018-07-10 12:53:02 -04:00
cyian-1756
6c64f73daa Fixed minor bug with DeviantartRipper 2018-07-09 11:38:14 -04:00
cyian-1756
13dd2694b4 Fixed multipart file downloading 2018-07-09 11:19:15 -04:00
cyian-1756
ea00d90a07 1.7.58: Fixed Deviantart ripper; fixed HitomiRipper; Fixed ManganeloRipper; Fixed update box formating 2018-07-08 07:05:46 -04:00
cyian-1756
2629d7ff00
Merge pull request #786 from cyian-1756/manganeloRipperFixes
Manganelo ripper fixes
2018-07-08 06:56:04 -04:00
cyian-1756
474252a7cb Fixed update box formating 2018-07-08 06:44:09 -04:00
cyian-1756
42c5a7be3f Changed ManganeloRipper unittest url to a smaller album, added test got getGid 2018-07-08 06:18:23 -04:00
cyian-1756
265e131045 Fixed ManganeloRipper 2018-07-08 06:17:51 -04:00
cyian-1756
66f354a046
Merge pull request #780 from cyian-1756/deviantartGalleryFixes
deviantart ripper fixes
2018-07-07 17:37:42 -04:00
cyian-1756
871e8984d8 Added getAlbumTitle for HitomiRipper 2018-07-07 04:03:59 -04:00
cyian-1756
c8e8139cf6 fixed HitomiRipper 2018-07-06 02:11:43 -04:00
cyian-1756
07670c98f8 Fixed Deviantart getUsernameFromURL 2018-07-06 01:32:28 -04:00
cyian-1756
e8f91d1794 DA ripper fixes 2018-07-05 04:35:03 -04:00
cyian-1756
9a29448e73 1.7.57: Got DeviantartRipper working again; Imagefap ripper now downloads full sized images; Twitter ripper can now rip extended tweets; Added nl_NL translation 2018-07-04 00:36:36 -04:00
cyian-1756
6ac6449815 Twitter ripper no longer rips retweets by default 2018-07-04 00:10:30 -04:00
cyian-1756
7f118c6164
Merge pull request #764 from rephormat/xhamsterPretty
Xhamster Descriptive Folder Naming
2018-07-04 00:07:04 -04:00
cyian-1756
e2cc147a96
Merge pull request #766 from cyian-1756/nl_NLTranslation
Added nl_NL translation
2018-07-04 00:06:07 -04:00
cyian-1756
c3b506e7ca Added nl_NL translation 2018-07-03 03:57:32 -04:00
cyian-1756
4b7bd12313 Uncommented out some code 2018-07-03 03:52:53 -04:00
cyian-1756
7eeb6b8378
Merge pull request #760 from cyian-1756/imageFapFix
Imagefap ripper now downloads full sized images
2018-07-03 02:25:39 -04:00
cyian-1756
c0a34fe7a1
Merge pull request #761 from cyian-1756/videoRipperPorts
Xvideo ripper now uses AbstractHTMLRipper
2018-07-03 02:24:51 -04:00
rephormat
aac4fa48f5 Use descriptive naming when Save album titles option is enabled. Format is xhamster_<user>_<gallery url>. 2018-07-02 19:49:47 -05:00
Jicksaw
31482fa0d8
Use paremeter tweet_mode=extended 2018-07-03 01:21:50 +03:00
cyian-1756
55c782dbab Imagefap ripper now downloads full sized images 2018-07-01 22:45:35 -04:00
cyian-1756
f6bb268b4c Added a unittest for the XvideosRipper 2018-07-01 22:32:44 -04:00
cyian-1756
7581d5d366 Xvideo ripper now uses AbstractHTMLRipper 2018-07-01 22:26:12 -04:00
cyian-1756
de0dda0d9f Added ripper for loveroms.com 2018-07-01 21:49:00 -04:00
cyian-1756
d0960fad75 Added better url sanitization for DeviantartRipper and some unit tests 2018-07-01 19:25:32 -04:00
cyian-1756
0ed2a7ddac DeviantartRipper can now rip nsfw images 2018-07-01 16:42:11 -04:00
cyian-1756
ae6d09c6e8 Added some unit tests for DeviantartRipper 2018-07-01 15:14:09 -04:00
cyian-1756
dab771f2da Got DeviantartRipper working again 2018-07-01 14:55:48 -04:00
cyian-1756
ef207890fc 1.7.56: Fixed DeviantartRipper ripper; Added support for resuming file downloads; Fixed erome ripper; Fixed ModelmayhemRipper NSFW image downloading 2018-06-30 18:35:13 -04:00
cyian-1756
3136f7bcdf
Merge pull request #754 from cyian-1756/daNewProfileUrl
Fixed  DeviantartRipper ripper
2018-06-30 18:21:40 -04:00
cyian-1756
c6aa3a2af9 Fixed DeviantartRipper unit tests 2018-06-29 23:04:13 -04:00