Commit Graph

880 Commits

Author SHA1 Message Date
Kevin Jiang
8960b8a565 Gfycat Tests & Fix for bad reddit submissions
Added sanitization, and appropriate tests.
Task #361 - Some gfycat doesn't work
2018-01-05 17:01:49 -05:00
cyian-1756
0758fae312 1.7.10: Added basic pornpics.com ripper; Fixed hentai.cafe regex 2018-01-04 15:46:38 -05:00
cyian-1756
9b4137e094
Merge pull request #367 from cyian-1756/hentai-cafe
Fixed hentai.cafe regex
2018-01-04 15:44:03 -05:00
cyian-1756
3f8349a018 instagram ripper can now be made to skip videos 2018-01-02 21:30:53 -05:00
cyian-1756
cff8e754b1 Removed commented out code for pornpicsRipper 2018-01-02 21:16:47 -05:00
cyian-1756
e972a9caac Added basic pornpics.com ripper 2018-01-02 21:09:50 -05:00
cyian-1756
6fab0375b0 Fixed hentai.cafe regex 2017-12-29 04:31:36 -05:00
cyian-1756
97975a6257
Merge pull request #365 from kevin51jiang/MoreDocumentation
3 Metric Tons of Javadoc documentation for core Ripper stuff.
2017-12-29 04:21:26 -05:00
Kevin Jiang
5b49514e3e 3 Metric Tons of Javadoc documentation for Core Ripper stuff.
There should be no changes to the code. Just a ton of documentation.
It should help newcomers get aquainted with code quicker.
2017-12-28 00:04:23 -05:00
cyian-1756
195dbb2970 1.7.9: FuraffinityRipper can now rip non-public albums; Added 2 new api keys, ripper can now download raw images from tumblr; Erome ripper now matchs links without the www; Tumblr ripper now tells the user if it hits the rate limit 2017-12-27 02:59:10 -05:00
cyian-1756
6d0c562180
Merge pull request #348 from cyian-1756/erome
Erome ripper now matchs links without the www
2017-12-27 02:56:15 -05:00
cyian-1756
c08f053b36
Merge pull request #354 from cyian-1756/tumblr
Tumblr
2017-12-27 02:55:48 -05:00
cyian-1756
dfeb0c3616 FuraffinityRipper can now rip non-public albums 2017-12-24 08:39:27 -05:00
cyian-1756
8a80eb02a3 Added 2 new api keys, ripper can now download raw images from tumblr 2017-12-24 06:45:13 -05:00
cyian-1756
201c3fb086 Tumblr ripper can now rip raw images 2017-12-21 03:40:32 -05:00
cyian-1756
d06a0ae11b Erome ripper now matchs links without the www 2017-12-18 14:35:20 -05:00
cyian-1756
44ab7fd29a Tumblr ripper now tells the user if it hits the rate limit 2017-12-17 00:51:42 -05:00
cyian-1756
8b96bc01e8 1.7.8: Forced https for tumblr image links; Fixed imgur album filenames; SankakuComplexRipper now downloads full sized images; Added dribbble.com ripper; Added comfirm button for clearing history 2017-12-16 16:18:48 -05:00
cyian-1756
7c1f2955c4
Merge pull request #332 from GrigoreAlexandru/master
Added dribbble.com ripper
2017-12-16 16:13:09 -05:00
cyian-1756
7363efed6a
Merge pull request #322 from Varinara/feature
added additional button for clearing history
2017-12-16 16:12:50 -05:00
cyian-1756
d3f658222d
Merge pull request #340 from cyian-1756/tumblr-fix
Forced https for tumblr image links
2017-12-16 16:11:50 -05:00
cyian-1756
dbe39a89b8 Forced https for tumblr image links 2017-12-16 00:13:35 -05:00
cyian-1756
c0025a3b29 Fixed imgur album filenames 2017-12-14 22:38:22 -05:00
cyian-1756
57a53688e4 SankakuComplexRipper now downloads full sized images (#328) 2017-12-10 18:59:08 -08:00
Up rising
4d71cb2757 Added dribbble.com ripper 2017-12-10 16:23:25 +02:00
Artyom Yurkov
3c15993911
Update MainWindow.java 2017-12-07 20:00:18 +03:00
Artyom Yurkov
9f87b0322d
Update MainWindow.java 2017-12-07 18:38:20 +03:00
Artyom Yurkov
981898dc2a
Update MainWindow.java 2017-12-07 18:30:52 +03:00
cyian-1756
a6934f959d 1.7.7: Fixed E621 Ripper; Added unit test for zizki.com; Added unit test for Xbooru.com; Updated reddit useragent 2017-12-07 02:17:25 -05:00
cyian-1756
1b36fa766f
Merge pull request #310 from cyian-1756/reddit-useragent
Updated reddit user agent
2017-12-07 02:15:35 -05:00
cyian-1756
d1f7708366
Added missing / 2017-12-07 02:05:57 -05:00
Varinara
6b4b4c0ac4 first commit 2017-12-05 03:27:07 +03:00
cyian-1756
61169352cb Moved hasASAPRipping() from AbstractHTMLRipper to AbstractRipper 2017-12-02 19:20:09 -05:00
cyian-1756
761f1e2987 Fixed bug that caused no images to be downloaded 2017-12-02 05:09:22 -05:00
cyian-1756
e89b27dc14 Added hasASAPRipping(), which if returns true allows a ripper to not return anything from getURLsFromPage() 2017-12-02 04:49:53 -05:00
cyian-1756
f82bb53eb7 Fixed E621 Ripper 2017-12-02 04:25:42 -05:00
cyian-1756
08c1b861bc Updated reddit user agent 2017-12-01 20:17:00 -05:00
metaprime
1f9c824722 1.7.6: Added OglafRipper 2017-12-01 11:17:24 -08:00
cyian-1756
2c2159aa32 Oglaf ripper (#309)
* Added OglafRipper

* Better folder naming for Oglaf ripper

* Added oglaf unit test
2017-12-01 11:15:56 -08:00
metaprime
b4df24ffe7 1.7.5: Improve WordpressComicRipper; update to a modern User Agent 2017-11-29 23:12:37 -08:00
metaprime
7716c47cc2
Fix #98: Update User Agent to current most common UA (Chrome 61 on Windows 10 x64) (#300) 2017-11-29 23:11:35 -08:00
cyian-1756
6ea6e7eded Reduce hardcoding in Wordpress comics (#299) 2017-11-29 22:37:08 -08:00
metaprime
30e1cadca9 1.7.4: Fix WordpressComicRipper konradokonski.com/wiory; Fix CheveretoRipper hushpix.com by adding consent cookie 2017-11-29 03:41:30 -08:00
metaprime
5c95fedd5c
Merge pull request #296 from metaprime/hushpix-consent
Format CheveretoRipper; implement AGREE_CONSENT cookie for hushpix; add CheveretoRipperTest
2017-11-29 03:37:53 -08:00
metaprime
cea853f38e Format CheveretoRipper; implement AGREE_CONSENT cookie for hushpix. 2017-11-29 03:18:29 -08:00
metaprime
3ff05e171c Fix konradokonski.com/wiory ripper 2017-11-29 02:55:07 -08:00
metaprime
ad3551b3db
Merge pull request #281 from cyian-1756/ui_tweaks
UI refactoring
2017-11-29 01:58:36 -08:00
cyian-1756
37c7e19cf5 1.7.3: Minor improvements to Aerisdies folder naming; Change folder name in imagearn; Fixed ripper for tapas.io; Rewrote xhamster ripper to use mobile site; Instagram ripper can now downloads slideshows when ripping user profiles 2017-11-27 17:41:18 -05:00
cyian-1756
1c4a0bb1ab
Merge pull request #275 from cyian-1756/xhamster_rewrite
Rewrote xhamster ripper to use the html only mobile site and not the JS heavy beta site
2017-11-27 17:34:12 -05:00
cyian-1756
3f0f5daff3
Merge pull request #276 from cyian-1756/tapas
Fixed Tapas ripper
2017-11-27 17:27:38 -05:00
cyian-1756
0fc3b1c14c
Merge pull request #274 from cyian-1756/ig_useraccount_slide_show
Instagram ripper now downloads slide shows when ripping user profiles
2017-11-27 17:26:46 -05:00
cyian-1756
872c100ca5
Merge pull request #277 from cyian-1756/AerisDies
Minor improvements to Aerisdies folder naming
2017-11-27 17:26:13 -05:00
EgorGornak
bd6359babd
Add getGid() 2017-11-28 01:11:03 +03:00
EgorGornak
dc66b03c16
Added getGID() 2017-11-28 01:06:38 +03:00
EgorGornak
bf746aadbc
Update ImagearnRipper.java 2017-11-28 01:03:19 +03:00
EgorGornak
bc2e099093 Change folder name 2017-11-27 23:36:32 +03:00
EgorGornak
ef1bf79ddd Change folder name in imagearn 2017-11-27 17:37:04 +03:00
cyian-1756
af64e33920 Fixed autorip from clipboard checkbox listener 2017-11-26 15:44:19 -05:00
cyian-1756
66212725bd Some more minor refactoring 2017-11-25 22:41:58 -05:00
cyian-1756
ff6aeeda68 Some refactoring of the config checkboxes 2017-11-25 22:35:24 -05:00
cyian-1756
d3a3e6af03 Some minor refactoring 2017-11-25 22:02:30 -05:00
cyian-1756
ef84cb143b Minor improvements to Aerisdies folder naming 2017-11-23 10:56:43 -05:00
cyian-1756
36cd9c713f Minor improvements to Aerisdies folder naming 2017-11-23 10:50:06 -05:00
cyian-1756
5fc50e524b Fixed ripper for tapas.io 2017-11-23 00:51:37 -05:00
cyian-1756
8e2d32a6bc Rewrote xhamster ripper to use mobile site 2017-11-23 00:18:09 -05:00
cyian-1756
47822f612e Better naming output for instagram slide shows 2017-11-22 18:34:08 -05:00
cyian-1756
2e5f8a99b9 Instagram ripper can now downloads slideshows when ripping user profiles 2017-11-22 18:28:00 -05:00
metaprime
f6d58ee748 1.7.2: InstagramRipper: Added support for ripping individual posts 2017-11-21 13:08:22 -08:00
cyian-1756
9d9cf61961 Added support for ripping single pages from instagram (#239)
* Added support for ripping from single pages

* Removed whitespace

* Instagram folder naming improvments

* Added GID tests for instagram single pages

* Added some album download tests for instagram

* Commented out flaky unit test
2017-11-21 13:07:25 -08:00
metaprime
8840a2baa1 1.7.1: Fix WordpressComicRipper's ripper for freeadultcomix.com; FuraffinityRipper can now rip public albums 2017-11-21 13:03:48 -08:00
metaprime
fc32fbe713
Merge pull request #267 from metaprime/test-wordpress
Add WordpressComicRipperTest; remove dead site comics-xxx.com
2017-11-21 13:02:16 -08:00
cyian-1756
0b3f259873 Started on fixing furaffinity ripper 2017-11-21 12:51:00 -08:00
metaprime
9632fcd554 Add test for thisis.delvecomic.com 2017-11-21 12:47:53 -08:00
metaprime
bb0678644c comics-xxx.com no longer exists 2017-11-21 12:47:53 -08:00
metaprime
bbb4770a11 Add WordpressComicRipperTest 2017-11-21 12:47:53 -08:00
metaprime
f630123a6e
Fix WordpressComicRipper's ripper for freeadultcomix.com (#270) 2017-11-21 12:46:58 -08:00
metaprime
4f12914da4 1.7.0: Improved webtoons folder naming; Added code coverage with Coveralls.io; improved unit tests and code coverage; removed rippers for dead sites 2017-11-21 12:22:23 -08:00
cyian-1756
7b912dfa64 Improved webtoons folder naming (#265) 2017-11-21 12:12:13 -08:00
metaprime
1000fb78e8 Removed SupertangasRipper (no longer any static content to download) 2017-11-21 04:44:45 -08:00
metaprime
d1aad83d28 Removed MediacrushRipper (permanently down) 2017-11-21 04:23:21 -08:00
metaprime
0afe0377f2 Removed FapprovedRipper (permanently down) 2017-11-21 04:19:04 -08:00
metaprime
14b35a0072 Remove DatwinRipper (datw.in permanently down) 2017-11-21 04:13:12 -08:00
metaprime
46e2ce074a Remove CheebyRipper (cheeby.com permanently down) 2017-11-21 04:10:38 -08:00
metaprime
7ee18bea79 Remove ButttoucherRipper (butttoucher.com is permanently down) 2017-11-21 04:07:47 -08:00
metaprime
d64282ed7b Fix #115: Remove GifyoRipper (gifyo.com no longer exists) 2017-11-21 03:45:49 -08:00
metaprime
b296137b93
Fix #242: Remove broken and not valuable FineboxRipper (#245) 2017-11-21 03:07:36 -08:00
metaprime
dffe9a40aa ImageStash.com is permanently down: remove ImagestashRipper 2017-11-21 02:05:29 -08:00
metaprime
5510b407ad
Fix loggers (#235) 2017-11-19 19:42:12 -08:00
metaprime
9e37d5de27
Remove utils/AES.java (#234) 2017-11-19 19:17:05 -08:00
cyian-1756
08d5e665f4 1.6.13: Added support for ripping from instagram tags; Instagram regex now matches all ripable urls; improved regex for pichunter 2017-11-18 09:23:01 -05:00
cyian-1756
ecf72e517e
Merge pull request #222 from cyian-1756/ig_hashtag
Added support for ripping from IG tags
2017-11-18 09:16:21 -05:00
cyian-1756
bcf3f9d2a7 Instagram ripper now handles urls with and without a trailing / 2017-11-18 09:07:25 -05:00
cyian-1756
73b165c645
Merge pull request #220 from cyian-1756/ig_regex
Improved instagram regex and added sanitizeURL
2017-11-18 08:53:09 -05:00
cyian-1756
e8185aaf3e Added support for ripping from tags 2017-11-18 07:22:25 -05:00
cyian-1756
5c185c05df Improved instagram regex and added sanitizeURL 2017-11-18 03:52:17 -05:00
cyian-1756
9214ce14bb Improved regex for pichunter.com 2017-11-17 17:15:56 -05:00
metaprime
67db5f3d99 1.6.12: Fix InstagramRipper with timestamps; Pichunter galleries support; logging improvements 2017-11-17 02:39:48 -08:00
cyian-1756
d268bb2cee Pichunter galleries support (#209)
* Added support for pichunter galleries

* Added unit test for pichunter galleries
2017-11-17 02:37:47 -08:00
metaprime
fad35d1afb
Fix #211: Add Utils.filesystemSanitized and apply to filename prefix. (#213) 2017-11-17 02:37:02 -08:00
metaprime
5912eb9c8a
Update size abbreviations e.g. from kb, mb, to KiB, MiB (#212) 2017-11-17 02:36:21 -08:00
cyian-1756
a2fc44aced Logging fixes (#189) 2017-11-17 02:35:37 -08:00
cyian-1756
2efcc0af1f 1.6.11: dded pichunter.com ripper; Changed instagram output name format; added tehyiffgallery ripper; Fixed xchan ripper; Fixed regession in chanRipper folder naming 2017-11-16 18:24:53 -05:00
cyian-1756
6e24a72314
Merge pull request #177 from cyian-1756/instagram_add_date
Change to IG ripper filename format and move from JSON ripper to HTML
2017-11-16 18:19:04 -05:00
cyian-1756
d435b1a638
Merge branch 'master' into pichunter 2017-11-16 18:09:11 -05:00
cyian-1756
0b2ff13c3e
Merge pull request #207 from cyian-1756/theyiffgallery
Added ripper for theyiffgallery
2017-11-16 17:53:00 -05:00
cyian-1756
a6b3f50b73 Added ripper for Theyiffgallery 2017-11-16 16:18:17 -05:00
cyian-1756
9837f893f1 pichunter now supports all album types 2017-11-16 14:35:40 -05:00
cyian-1756
fc5d4b7533 pichunter ripper no longer errors out on last page 2017-11-16 14:09:03 -05:00
cyian-1756
149ab50dc1 Added basic pichunter ripper 2017-11-16 13:58:21 -05:00
cyian-1756
669a78434c Added regex for xchan 2017-11-14 13:39:38 -05:00
cyian-1756
4016f35ab4 Ripper now falls back to getHost() and getGID(), not page title 2017-11-14 13:22:20 -05:00
cyian-1756
c1de0ff8e5 Added getCookies func (#184) 2017-11-13 02:17:21 -08:00
cyian-1756
07f180ee70 Removed repetitive func 2017-11-12 05:00:39 -05:00
cyian-1756
d1e021f0ef Added single post support to the instagram ripper 2017-11-12 04:43:26 -05:00
cyian-1756
7f57768f3d instagram ripper now puts the date the image was posted in the saved file name 2017-11-12 03:15:56 -05:00
cyian-1756
be769a1389 1.6.10: Added viewcomic ripper; Fixed webtoons malformed url error message; Fixed chan ripper thread title; Fixed Modelmayhem ripper 2017-11-12 02:31:23 -05:00
cyian-1756
79958b1342
Merge pull request #71 from cyian-1756/view-comic
Added viewcomic ripper
2017-11-12 02:24:00 -05:00
cyian-1756
22f438f445
Merge pull request #163 from RipMeApp/webtoons
Fixed webtoons malformed url error message
2017-11-12 02:22:52 -05:00
cyian-1756
690abe848f
Merge pull request #172 from cyian-1756/chanRipperFixes
Fixed chan ripper thread title (For real this time)
2017-11-12 02:20:25 -05:00
cyian-1756
ebacc90915
Merge pull request #173 from cyian-1756/ModelMayhamFixes
Fixed Modelmayhem ripper
2017-11-11 07:32:57 -05:00
cyian-1756
0845efe328 Fixed Modelmayhem ripper 2017-11-11 03:10:08 -05:00
cyian-1756
2de9d58cca Fixed chan ripper thread title (For real this time) 2017-11-11 01:56:36 -05:00
cyian-1756
4a5588c06c
Merge pull request #171 from cyian-1756/chanRipperFixes
Chan ripper now falls back on page title if thread title can not be …
2017-11-11 01:41:26 -05:00
cyian-1756
84cf9b1fc5 Chan ripper now falls back on page title if thread title can not be found 2017-11-10 21:26:16 -05:00
cyian-1756
ffb26c2fe0 Chan ripper now falls back on page title if thread title can not be found 2017-11-10 09:29:26 -05:00
cyian-1756
33f782155c 1.6.9: Added support for imgur /t/ albums; Added portable mode; Unit tests no longer fail if run twice; Formating fixes 2017-11-10 04:00:39 -05:00
cyian-1756
3f2d119347
Merge pull request #162 from RipMeApp/url_history_fix
Remembering url history no longer causes unit tests to fail
2017-11-10 03:58:30 -05:00
cyian-1756
d70df6e9be
Merge pull request #156 from cyian-1756/portable
Added portable mode
2017-11-10 03:45:48 -05:00
cyian-1756
806a198cf0
Merge pull request #157 from RipMeApp/imgur_t_albums
Added support for imgur /t albums
2017-11-10 03:45:32 -05:00
cyian-1756
3c84dde846
Merge pull request #104 from cyian-1756/hentai.cafe
Minor formatting fix for HentaiCafe ripper
2017-11-10 03:42:59 -05:00
cyian-1756
5a81e080f5 Fixed webtoons malformed url error message 2017-11-09 22:02:19 -05:00
cyian-1756
0b7dada59a Remembering url history no longer causes unit tests to fail 2017-11-09 20:59:31 -05:00
cyian-1756
e584e64206 Added support for imgur /t albums 2017-11-09 01:45:32 -05:00
cyian-1756
9302e0be35 Removed debugging statement 2017-11-08 19:54:00 -05:00
cyian-1756
e4d7950336 Ripme now runs in portable mode if in the same dir as a rip.properties file 2017-11-08 19:45:06 -05:00
cyian-1756
83aac613b5 1.6.8: code clean up; ripme can now remeber and skip already downloaded images 2017-11-08 16:22:41 -05:00
cyian-1756
958643c4e3
Merge pull request #144 from cyian-1756/remember_downloaded
Remember downloaded URLs
2017-11-08 16:21:31 -05:00
cyian-1756
5a93260179 Removed unused imports 2017-11-08 03:03:09 -05:00
cyian-1756
79b912aabe 1.6.7: Fixed instagram ripper 2017-11-08 00:26:10 -05:00
cyian-1756
dfab4f6f34 removed test case for private account 2017-11-08 00:19:55 -05:00
cyian-1756
86f7c62213 IG ripper no longer errors out on finish 2017-11-07 23:48:08 -05:00
cyian-1756
b5d09cdc97 IG ripper can now rip videos 2017-11-07 23:40:14 -05:00
cyian-1756
dbdedd7d5a IG ripper can now rip images from all pages 2017-11-07 23:05:08 -05:00
cyian-1756
a3b533922b Instagram can now rip from single pages 2017-11-07 22:24:32 -05:00
cyian-1756
14130580d7 1.6.6: Fixed 8muses ripper 2017-11-07 21:11:34 -05:00
cyian-1756
3ad8454a0c Fixed 8muses ripper 2017-11-07 21:04:38 -05:00
cyian-1756
d5c1efd939 Now uses checkbox for remember.url_history setting 2017-11-07 15:23:41 -05:00
cyian-1756
9898c149e1 Added Utils.getURLHistoryFile() func to get the URL history file path, clearing history now deletes url history file 2017-11-07 04:49:39 -05:00
cyian-1756
169547d745 Change method that didn't need to be public to private 2017-11-07 04:27:36 -05:00
cyian-1756
c69613d8a5 Ripme now remembers downloaded URLs and doesn't try to redownload them 2017-11-07 04:11:13 -05:00