Commit Graph

257 Commits

Author SHA1 Message Date
6858565b14 updated crawler 2019-12-01 19:35:02 +01:00
fd6f20da6a added WebServer Wrapper
Crawl more reddit metadata
save data tp sqlite
2018-10-10 23:58:01 +02:00
cyian-1756
bf6987174b 1.7.67: Added yuki.la ripper; Fixed xhamster ripper; Fixed instagram ripper; Added porncomix.one ripper; Fixed bug which caused large files to be download when running tests 2018-10-06 10:43:21 -04:00
cyian-1756
7e890bce2f 1.7.66: Added pl_PL translation; Ported various video rippers to AbstractSingleFileRipper; Erome now downloads both HD and SD video; Can now download embedded images from tumblr; Fixed 8muses folder naming; Added ripper for Tubex6.com 2018-09-30 13:33:08 -04:00
cyian-1756
e24d8f6853 1.7.65: removed RajceRipper; Fixed xhamster ripper; Added xhamster QuickQ support; added StickyXXX.com Ripper; added Mulemax.com Ripper; added SpankBang.com Ripper; fixed LusciousRipper 2018-09-15 15:11:39 -04:00
cyian-1756
3f84496084 1.7.64: Removed loveroms ripper; Update ru_RU lang file; Removed tumblr raw image downloading; getFilesFromURL now can handle imgur videos; 8muses ripper now gets full sized images; Added -a flag for appending a string to folder name 2018-09-10 06:23:32 -04:00
cyian-1756
3ea519d224 1.7.63: Removed line wrapping; Added anillty to rip url ranges; Fixed gfycatRipper 2018-08-24 14:18:27 -04:00
cyian-1756
ac599e236e 1.7.62: Added hentai-comic and hentai-image rippers; Fixed HitomiRipper; Added hqporner ripper; Added Gelbooru.com ripper; Added line wrapping in log window 2018-08-23 09:00:27 -04:00
cyian-1756
2d4dd89bfc 1.7.61: Re-add 8Chan support; Added kenzato.uk to CheveretoRippers; Added russian translation; Reddit ripper now uses sub folders; fixed JabArchivesRipper regex 2018-08-04 13:31:46 -04:00
cyian-1756
24b1c7175e 1.7.60: Fixed EightmusesRipper; added Jab Archives ripper; loveroms ripper now properly names files; Fixed ArtStationRipper 2018-07-25 00:28:39 -04:00
cyian-1756
cbfd363842 1.7.59: Added Loverom ripper; added Imagearn ripper; Added support for Desuarchive.org; Fixed erome ripper 2018-07-14 14:56:45 -04:00
cyian-1756
ea00d90a07 1.7.58: Fixed Deviantart ripper; fixed HitomiRipper; Fixed ManganeloRipper; Fixed update box formating 2018-07-08 07:05:46 -04:00
cyian-1756
9a29448e73 1.7.57: Got DeviantartRipper working again; Imagefap ripper now downloads full sized images; Twitter ripper can now rip extended tweets; Added nl_NL translation 2018-07-04 00:36:36 -04:00
cyian-1756
ef207890fc 1.7.56: Fixed DeviantartRipper ripper; Added support for resuming file downloads; Fixed erome ripper; Fixed ModelmayhemRipper NSFW image downloading 2018-06-30 18:35:13 -04:00
cyian-1756
a855957ab1 1.7.55: Fixed instagram ripper; Reddit ripper now respects history.end_rip_after_already_seen; Improvements to patch.py and release.py 2018-06-23 19:03:46 -04:00
cyian-1756
c445ab422f 1.7.54: Fixed twitter ripper video downloading; fixed instagram ripper 2018-06-19 16:29:48 -04:00
cyian-1756
53684ca169 1.7.53: Added Picstatio ripper; Fixed instagram ripper; Reddit ripper now gets videos from v.redd.it; Fixed ZikiRipper getAlbumTitle; fixed twitter ripper 2018-06-18 21:00:52 -04:00
cyian-1756
6cae35ccfb 1.7.52: Added warning about using furaffinty shared account; Refactoring in Utils class; XhamsterRipper now accepts all countries subdomains; E621 ripper now accepts urls with order:Score at the end; release.py imrpovements; DeviantartRipper now logs in using cookies; patch.py imrpovements 2018-06-15 16:23:10 -04:00
cyian-1756
9531f44583 1.7.51: Fixed instagram ripper; Added the ability to rip from vsco profiles; Fixed TheyiffgalleryRipper; Can now update ripme using the -j flag; added script to automate releases; Code style fixes 2018-06-07 07:10:14 -04:00
cyian-1756
ea7573a975 Added maven plugin to make builds reproducible; build.sh and build.bat now strip the compiled jar of any non-reproducable metadata; Removed Executable Bit from build.bat 2018-05-31 04:37:36 -04:00
cyian-1756
6fde66cd4d 1.7.50: Ripme now checks file hash before running update; fixed update bug which cased ripme to report every update as new 2018-05-30 15:31:04 -04:00
cyian-1756
23ded9f6f4 1.7.49: Fixed -n flag; Added ability to change locale at runtime and from gui; Update kr_KR translation; Removed support for tnbtu.com; No longer writes url to url_history file is save urls only is checked 2018-05-30 00:28:16 -04:00
cyian-1756
3c925b4eee 1.7.48: Fixed instagram ripper; Added Korean translation; Added quickQueue support to nhentairipper; Rewrote nhentairipper to be faster; myhentaicomics ripper now requests proper url when downloading images; Can now include comments in url files; Added the ability to blacklist tags on e-hentai.org" 2018-05-25 16:03:38 -04:00
cyian-1756
d11dfe814b 1.7.47: Added quick queue support for hentai2read ripper; Fixed instagram ripper; SankakuComplexRipper can now download from different subdomains; Added ripper for bato.to; Added quick queue support for 8muses.download; 2018-05-20 13:42:33 -04:00
cyian-1756
9785642512 1.7.46: Fixed hentai2read ripper; Rewrote the myhentaicomics ripper to use the new getAlbumsToQueue func; Can now blacklist nhentai tags; SinnercomicsRipper no longer adds -page-01 to folder names; EightmusesRipper now adds file extension to filename; disbaled test for twitch ripper 2018-05-16 12:04:19 -04:00
cyian-1756
34425361ae 1.7.45: Fixed hentai2read ripper; ImageBam album fixed; Added various translations; TsuminoRipper no longer requires album name to download 2018-05-13 09:14:42 -04:00
cyian-1756
19e4a95c96 1.7.44: Fixed instagram ripper regex 2018-05-10 07:30:05 -04:00
cyian-1756
c4eb31f1e9 1.7.43: Fixed queryId regex in instagram ripper 2018-05-09 03:09:41 -04:00
cyian-1756
925df36e31 1.7.42: Added user support to SmuttyRipper; Removed vine ripper; Fixed NudeGalsRipper; addURLToDownload improvments; Fixed Instagram ripper 2018-05-08 08:41:39 -04:00
cyian-1756
2d1e648bd1 1.7.41: Added support for spyingwithlana.com; Added ManganeloRipper; Added support for dynasty-scans.com 2018-05-05 05:41:48 -04:00
cyian-1756
e8f7f2cfae 1.7.40: Added hypnohub.net ripper; Fixed rule34.xxx ripper; Tsumino Ripper now add .png to filenames 2018-04-29 16:28:17 -04:00
cyian-1756
388cd9936d 1.7.39: Added rule34.xxx ripper; Added Gfycatporntube.com ripper; Fixed AbstractRipper subdir bug; Added AbstractRipper unit tests" 2018-04-26 12:42:24 -04:00
cyian-1756
eccce1b4a6 1.7.38: Added http and socks proxy support; Extended some unit tests to include getGid; Added HitomiRipper; hentaifoundry ripper now can rip all images from accounts 2018-04-21 14:22:48 -04:00
cyian-1756
a52bbeb6d8 1.7.37: MInor code clean up; Added socks proxy support; Added support for 8muses.download; Hentaifoundry no longer errors when there are no more pages; Fix bug that causes tumblr to replace https with httpss when downloading resized images 2018-04-19 16:23:34 -04:00
cyian-1756
1bc696504a 1.7.36: Fixed Instagram ripper; Fixed hentai2read ripper test; Fixed tnbtu.com ripper 2018-04-19 05:58:50 -04:00
cyian-1756
1dadd26e05 1.7.35: Fixed instagram ripper; hentai2read ripper now properly names folders 2018-04-17 04:23:05 -04:00
cyian-1756
5206f1d30e 1.7.34: Added Blackbrickroadofoz Ripper; Fixed webtoons regex 2018-04-15 05:45:41 -04:00
cyian-1756
fd0db7e242 1.7.33: Instagram ripper no longer errors out when downloading from more than 1 page 2018-04-13 05:49:47 -04:00
cyian-1756
6b4d01af1d 1.7.32: Instagram ripper update to use new enpoints 2018-04-10 18:52:52 -04:00
cyian-1756
23fee27792 1.7.31: InstaGram ripper no longer errors out when getting next page 2018-04-07 20:00:14 -04:00
cyian-1756
24f0752308 1.7.30: Fixed usage of command-line on non-headless systems 2018-04-03 10:45:10 -04:00
cyian-1756
338edd18f9 1.7.29: Cano now download single images from imgur; Improved handling of headless mode & OS-specific config; Added modelx ripper; Fixed eroshae ripper 2018-04-02 16:48:32 -04:00
cyian-1756
fc0e3588b6 1.7.28: IG ripper now uses display_url when downloading images; Reddit ripper now gets erome links; Hentaifoundry Ripper no longer errors out when there is no next page 2018-03-23 23:50:44 -04:00
cyian-1756
6cea9e3ff7 1.7.27: IG ripper can now rip from tags; fixed json parsing issues 2018-03-17 16:09:34 -04:00
cyian-1756
da338eb716 1.7.26: fixed instagram ripper 2018-03-15 13:40:11 -04:00
cyian-1756
8ba24eaa47 1.7.25: Fixed instagram ripper; Added an option to use short names for 8muses; Added tsuminoRipper; Added support for incase.buttsmithy.com 2018-03-14 12:58:34 -04:00
cyian-1756
c1f46d8251 1.7.24: Added sta.sh ripper; Added sinfest.com ripper; Added femjoyhunter.com ripper; Disabled flaky unit tests 2018-03-12 11:50:03 -04:00
cyian-1756
a4880ecf80 1.7.23: Fixed xvideos ripper; InstagramRipper now works with lastseenfeature 2018-03-10 12:33:31 -05:00
cyian-1756
a54b71065c 1.7.22: Added func to normalize urls before reading from/writing to url history file; last seen feature now works with instagram 2018-03-06 06:58:21 -05:00
cyian-1756
9f922e7965 1.7.21: Fixed last seen feature 2018-02-25 21:23:31 -05:00