Commit Graph

1289 Commits

Author SHA1 Message Date
cyian-1756
e56d47964d
Merge pull request #854 from cyian-1756/jabRegexFix
JabArchivesRipper now allows for www. to appear in url
2018-08-04 13:09:54 -04:00
cyian-1756
2f131ef51a
Merge pull request #847 from kevin51jiang/master
Re-recognize 8Chan URLs
2018-08-04 13:03:40 -04:00
cyian-1756
559e0860dd
Merge pull request #839 from jooxxxoooo/imgurAlbums
Added possibility to save reddit posts with multiple images in separat…
2018-08-04 13:00:28 -04:00
cyian-1756
292e977a22
Merge branch 'master' into moreMagicNumbers 2018-08-04 12:52:25 -04:00
cyian-1756
0dc648beb3 Tweaked regex a bit more 2018-08-04 12:45:35 -04:00
cyian-1756
2f45dc9211 Tweaked regex a bit more 2018-08-04 10:29:28 -04:00
cyian-1756
f38bb7ba9b JabArchivesRipper now allows for www. to appear in url 2018-08-03 20:59:50 -04:00
Kevin Jiang
6e26ba3e0b Re-add 8Chan support 2018-08-01 04:45:44 -04:00
cyian-1756
d71addb8a7 improved logging message and added comment for timeouts 2018-07-31 16:55:21 -04:00
cyian-1756
77a64a1dd7 Timeout now applies to both connection and read 2018-07-31 16:50:19 -04:00
cyian-1756
15c4b245fb
Merge pull request #837 from cyian-1756/codeDeduping
Added an Abstraction for rippers that only ever download a single file and want to use the bytes progress bar
2018-07-31 08:38:30 -04:00
cyian-1756
036ec91b43
Merge pull request #840 from cyian-1756/Chevereto
Added kenzato.uk to CheveretoRippers
2018-07-31 08:35:56 -04:00
cyian-1756
93b3f99069
Merge pull request #841 from cyian-1756/todoFixes
Removed outdated todo
2018-07-31 08:32:43 -04:00
cyian-1756
771159de56 Removed outdated todo 2018-07-29 10:48:46 -04:00
cyian-1756
0a0b6d299a Added kenzato.uk to CheveretoRippers 2018-07-29 10:37:15 -04:00
Johannes Drescher
407564feee Added possibility to save reddit post with multiple images in separate subdirectory with title name.
Added title to the saved filename when only one image/video.
2018-07-29 16:12:23 +02:00
cyian-1756
596be7b839 Added an Abstraction for rippers that only ever download a single file and want to use the bytes progress bar 2018-07-26 11:09:04 -04:00
cyian-1756
92005bfb31 Added russian translation 2018-07-25 08:51:04 -04:00
cyian-1756
abeb0b0984 Changed how magic number look ups are done (now uses a hash map); added magic number for png; added unit test 2018-07-25 03:16:41 -04:00
cyian-1756
24b1c7175e 1.7.60: Fixed EightmusesRipper; added Jab Archives ripper; loveroms ripper now properly names files; Fixed ArtStationRipper 2018-07-25 00:28:39 -04:00
cyian-1756
316a07cf77
Merge pull request #823 from cyian-1756/magicNumbers
Can now get file type from magic number; No longer erroneously redownloads file if getFileExtFromMIME is true
2018-07-25 00:22:05 -04:00
cyian-1756
fb329d26ce
Merge pull request #829 from cyian-1756/8musesFixes
Fixed EightmusesRipper
2018-07-25 00:16:32 -04:00
cyian-1756
0f3148f47f Removed some debugging statments 2018-07-25 00:03:28 -04:00
cyian-1756
af33869e52 Fixed EightmusesRipper 2018-07-24 23:49:53 -04:00
cyian-1756
cb1fec52f5 saveAs.exists() imrpovements 2018-07-23 03:12:03 -04:00
cyian-1756
1d60bf6956 Added a fuzzyExist func to check if a file exist when we don't know it's extension (For use with rippers that use getFileExtFromMIME) 2018-07-22 19:31:11 -04:00
cyian-1756
368646145d Can now get file type from magic number 2018-07-22 19:02:06 -04:00
cyian-1756
e67612993a
Merge pull request #812 from 0x1f595/jabarchives
Adding Jab Archives ripper
2018-07-21 17:17:03 -04:00
cyian-1756
e0c9822331
Merge pull request #813 from cyian-1756/loveromRipper
loveroms ripper now properly names files
2018-07-21 16:54:12 -04:00
cyian-1756
f3fe3ebebd
Merge pull request #816 from mbc07/ArtStation_multi_page_fix
ArtStationRipper: fix ripping from user profiles which many projects
2018-07-21 16:52:25 -04:00
cyian-1756
0324c94961
Merge pull request #814 from cyian-1756/redditImgurGifv
getFilesFromURL now handles imgur gifvs
2018-07-21 16:43:59 -04:00
Samuel P. Bowman
55a76ba7e1 fixed issues with prior fix 2018-07-19 09:51:13 -04:00
cyian-1756
0c4ec95ca4 Fixed xhamster getNextPage 2018-07-19 00:21:39 -04:00
Mateus B. Cassiano
47cab78843 ArtStationRipper: fix ripping from user pages with more than 50 projects 2018-07-16 02:08:03 -04:00
cyian-1756
726e303a08 improved how riputils gets imgur mp4s 2018-07-15 15:03:56 -04:00
cyian-1756
3f7b6711e3 getFilesFromURL now handles imgur gifvs 2018-07-15 14:39:14 -04:00
cyian-1756
1cf4aba2ab loveroms ripper now properly names files 2018-07-15 14:24:26 -04:00
0x1f595
daae074713 Use SSL by default on Jav Archives 2018-07-14 13:10:53 -06:00
0x1f595
27530965c2 Merge remote-tracking branch 'upstream/master' 2018-07-14 13:07:48 -06:00
0x1f595
7cf3a01379 Adding Jab Archives ripper
This currently only supports ripping bottom-level folders. If a folder you rip contains another folder, that subfolder will not be fully ripped, only the source image from its thumbnail will be included in the rip.
2018-07-14 13:06:29 -06:00
cyian-1756
cbfd363842 1.7.59: Added Loverom ripper; added Imagearn ripper; Added support for Desuarchive.org; Fixed erome ripper 2018-07-14 14:56:45 -04:00
cyian-1756
26288a5cb4
Merge pull request #800 from cyian-1756/desuarchive
Added support for Desuarchive.org
2018-07-14 14:49:26 -04:00
cyian-1756
1f9e5506ff
Merge pull request #806 from cyian-1756/manganeloFixes
Fixed ManganeloRipper
2018-07-14 14:48:56 -04:00
cyian-1756
4074fcc448
Merge pull request #807 from cyian-1756/eromeVideos
Fixed erome video downloading
2018-07-14 14:48:43 -04:00
cyian-1756
0bf6381ede
Merge pull request #809 from cyian-1756/imagearn
Readded Imagearn ripper and test
2018-07-14 14:48:18 -04:00
cyian-1756
6cdf918ada
Merge pull request #788 from cyian-1756/loveromRipper
Loverom ripper [WIP]
2018-07-14 14:47:44 -04:00
cyian-1756
3f18d8a990 Readded Imagearn ripper and test 2018-07-13 20:06:54 -04:00
cyian-1756
3287b8c59a Fixed erome video downloading 2018-07-13 19:01:55 -04:00
cyian-1756
a65ad6f756 Fixed ManganeloRipper 2018-07-13 18:14:36 -04:00
Samuel P. Bowman
5622d55c3e Fix Issue 789: Implemented wraparound in log window and status label. 2018-07-13 13:19:54 -04:00
cyian-1756
3553118b54 Added support for Desuarchive.org 2018-07-12 13:44:45 -04:00
cyian-1756
35d24d22a5
Merge pull request #796 from cyian-1756/cli_crash_fix
No longer tries to send download compete message every time ripme sav…
2018-07-11 13:54:33 -04:00
cyian-1756
96738883b0
Merge pull request #791 from cyian-1756/deviantartGalleryFixes
Fixed minor bug with DeviantartRipper
2018-07-11 13:43:47 -04:00
cyian-1756
fc52da3497 No longer tries to send download compete message every time ripme saves a url to a text file 2018-07-11 13:40:09 -04:00
cyian-1756
67e2451744 Now properly names multi-part files; Updated to work with recent changes to site 2018-07-10 13:24:56 -04:00
cyian-1756
59dd904c22 Now prints error when ripme can't get a files type from the stream 2018-07-10 12:53:02 -04:00
cyian-1756
6c64f73daa Fixed minor bug with DeviantartRipper 2018-07-09 11:38:14 -04:00
cyian-1756
13dd2694b4 Fixed multipart file downloading 2018-07-09 11:19:15 -04:00
cyian-1756
ea00d90a07 1.7.58: Fixed Deviantart ripper; fixed HitomiRipper; Fixed ManganeloRipper; Fixed update box formating 2018-07-08 07:05:46 -04:00
cyian-1756
2629d7ff00
Merge pull request #786 from cyian-1756/manganeloRipperFixes
Manganelo ripper fixes
2018-07-08 06:56:04 -04:00
cyian-1756
474252a7cb Fixed update box formating 2018-07-08 06:44:09 -04:00
cyian-1756
265e131045 Fixed ManganeloRipper 2018-07-08 06:17:51 -04:00
cyian-1756
66f354a046
Merge pull request #780 from cyian-1756/deviantartGalleryFixes
deviantart ripper fixes
2018-07-07 17:37:42 -04:00
cyian-1756
871e8984d8 Added getAlbumTitle for HitomiRipper 2018-07-07 04:03:59 -04:00
cyian-1756
c8e8139cf6 fixed HitomiRipper 2018-07-06 02:11:43 -04:00
cyian-1756
07670c98f8 Fixed Deviantart getUsernameFromURL 2018-07-06 01:32:28 -04:00
cyian-1756
e8f91d1794 DA ripper fixes 2018-07-05 04:35:03 -04:00
cyian-1756
9a29448e73 1.7.57: Got DeviantartRipper working again; Imagefap ripper now downloads full sized images; Twitter ripper can now rip extended tweets; Added nl_NL translation 2018-07-04 00:36:36 -04:00
cyian-1756
6ac6449815 Twitter ripper no longer rips retweets by default 2018-07-04 00:10:30 -04:00
cyian-1756
7f118c6164
Merge pull request #764 from rephormat/xhamsterPretty
Xhamster Descriptive Folder Naming
2018-07-04 00:07:04 -04:00
cyian-1756
e2cc147a96
Merge pull request #766 from cyian-1756/nl_NLTranslation
Added nl_NL translation
2018-07-04 00:06:07 -04:00
cyian-1756
c3b506e7ca Added nl_NL translation 2018-07-03 03:57:32 -04:00
cyian-1756
4b7bd12313 Uncommented out some code 2018-07-03 03:52:53 -04:00
cyian-1756
7eeb6b8378
Merge pull request #760 from cyian-1756/imageFapFix
Imagefap ripper now downloads full sized images
2018-07-03 02:25:39 -04:00
cyian-1756
c0a34fe7a1
Merge pull request #761 from cyian-1756/videoRipperPorts
Xvideo ripper now uses AbstractHTMLRipper
2018-07-03 02:24:51 -04:00
rephormat
aac4fa48f5 Use descriptive naming when Save album titles option is enabled. Format is xhamster_<user>_<gallery url>. 2018-07-02 19:49:47 -05:00
Jicksaw
31482fa0d8
Use paremeter tweet_mode=extended 2018-07-03 01:21:50 +03:00
cyian-1756
55c782dbab Imagefap ripper now downloads full sized images 2018-07-01 22:45:35 -04:00
cyian-1756
7581d5d366 Xvideo ripper now uses AbstractHTMLRipper 2018-07-01 22:26:12 -04:00
cyian-1756
de0dda0d9f Added ripper for loveroms.com 2018-07-01 21:49:00 -04:00
cyian-1756
d0960fad75 Added better url sanitization for DeviantartRipper and some unit tests 2018-07-01 19:25:32 -04:00
cyian-1756
0ed2a7ddac DeviantartRipper can now rip nsfw images 2018-07-01 16:42:11 -04:00
cyian-1756
ae6d09c6e8 Added some unit tests for DeviantartRipper 2018-07-01 15:14:09 -04:00
cyian-1756
dab771f2da Got DeviantartRipper working again 2018-07-01 14:55:48 -04:00
cyian-1756
ef207890fc 1.7.56: Fixed DeviantartRipper ripper; Added support for resuming file downloads; Fixed erome ripper; Fixed ModelmayhemRipper NSFW image downloading 2018-06-30 18:35:13 -04:00
cyian-1756
3136f7bcdf
Merge pull request #754 from cyian-1756/daNewProfileUrl
Fixed  DeviantartRipper ripper
2018-06-30 18:21:40 -04:00
cyian-1756
17a3e4eb50 DeviantartRipper can now rip more than one page again 2018-06-29 21:09:06 -04:00
cyian-1756
e83032906d Started work on fixing da ripper 2018-06-28 21:04:05 -04:00
cyian-1756
f698bdacde
Merge pull request #746 from cyian-1756/byteProgressBar
All rippers can now use a byte progress bar, added the ability to resume some file downloads
2018-06-28 06:52:06 -04:00
cyian-1756
c4588a03a6
Merge pull request #742 from cyian-1756/modelmayhemNSFWFix
ModelmayhemRipper can now donwload nsfw images again
2018-06-28 06:47:48 -04:00
cyian-1756
ffbda6032d Fixed bug that caused downloads from sites that support download resuming to fail with 'Server doesn't support resuming downloads' 2018-06-27 02:05:36 -04:00
cyian-1756
af064ee435 Minor code refactoring 2018-06-27 01:25:58 -04:00
cyian-1756
1f8e9184c7 Added the helper func getByteStatusText to cut down on copy pasted code 2018-06-27 01:24:04 -04:00
cyian-1756
ed7df108e5 Minor code style clean up 2018-06-27 01:02:23 -04:00
cyian-1756
04ca5a2054 Added support for resuming downloads 2018-06-27 00:51:28 -04:00
cyian-1756
b1718965c5 Removed ripper for dead site 2018-06-26 05:12:48 -04:00
cyian-1756
e1635f39e1 GfycatRipper now uses AbstractHTMLRipper 2018-06-26 02:28:14 -04:00
cyian-1756
9b70350b33 GfycatporntubeRipper now uses byte progess bar 2018-06-26 01:36:23 -04:00
cyian-1756
96a8801c19 Rippers can now choose to use a byte progess bar 2018-06-26 00:54:18 -04:00
cyian-1756
c4f2d52370 Fixed erome ripper and added quickQueue support 2018-06-25 05:32:37 -04:00