Skip to content

Releases: mikf/gallery-dl

v1.29.4

13 Apr 08:49
v1.29.4
2674705
Compare
Choose a tag to compare

Extractors

Additions

  • [chevereto] support imagepond.net (#7278)
  • [webtoons] add artist extractor (#7274)

Fixes

  • [deviantart] fix KeyError: 'has_subfolders' (#7272 #7337)
  • [discord] fix parent keyword inconsistency (#7341 #7353)
  • [E621:pool] fix AttributeError (#7265 #7344)
  • [everia] fix/improve image extraction (#7270)
  • [gelbooru] fix video URLs (#7345)
  • [hentai2read] fix AttributeError exception for chapters without artist (#7355)
  • [issuu] fix extractors (#7317)
  • [kemonoparty] fix file paths with backslashes (#7321)
  • [readcomiconline] fix issue extractor (#7269 #7330)
  • [rule34xyz] update to API v2 (#7289)
  • [zerochan] fix KeyError: 'author' (#7282)

Improvements

  • [instagram] use Chrome User-Agent by default (#6379)
  • [pixiv] support phixiv.net URLs (#7352)
  • [tumblr] support URLs without subdomain (#7358)
  • [webtoons] download JPEG files in higher quality
  • [webtoons] use a default 0.5-1.5s delay between requests (#7329)
  • [zzup] support w.zzup.com URLs (#7327)

Downloaders

  • [ytdl] fix KeyError: 'extractor' exception when ytdl reports an error (#7301)

Post Processors

  • [metadata] add metadata-path option (#6582)
  • [metadata] fix handling of empty directory paths (#7296)
  • [ugoira] preserve extension when using "mode": "archive" (#7304)

Miscellaneous

  • [formatter] add i and f conversions (#6582)

v1.29.3

29 Mar 09:56
v1.29.3
add52e6
Compare
Choose a tag to compare

Extractors

Additions

  • [danbooru] add favgroup extractor
  • [imhentai] support hentaienvy.com and hentaizap.com (#7192 #7218)

Fixes

  • [bunkr] fix filename extraction (#7237)
  • [deviantart:stash] fix legacy sta.sh links (#7181)
  • [hitomi] fix extractors (#7230)
  • [mangapark] fix extractors (#4999 #5883 #6507 #6908 #7232)
  • [nozomi] fix extractors (#7242)
  • [patreon] include subdomains in session_id cookie check (#7188)
  • [patreon] do not match /messages URLs as creator (#7187)
  • [pinterest] handle story_pin_static_sticker_block blocks (#7251)
  • [sexcom] fix gif pin extraction (#7239)
  • [skeb] make exceptions when extracting posts non-fatal (#7250)
  • [zerochan] parse JSON-LD data (#7178)

Improvements

  • [arcalive] extend gifs option
  • [deviantart] support multiple images for single posts (#6653 #7261)
  • [deviantart] add subfolder support (#4988 #7185 #7220)
  • [deviantart] match /gallery/recommended-for-you URLs (#7168 #7243)
  • [instagram] extract videos from video_dash_manifest data (#6379 #7006)
  • [mangapark] support mirror domains
  • [mangapark] support v3 URLs (#2072)
  • [mastodon] support /statuses URLs (#7255)
  • [sexcom] support new-style /gifs and /videos URLs (#7239)
  • [subscribestar] detect redirects to /age_confirmation_warning pages
  • [tiktok] add retry mechanism to rehydration data extraction (#7191)

Metadata

  • [bbc] extract more metadata (#6582)
  • [kemonoparty] extract archives metadata (#7195)
  • [kemonoparty] enable username/user_profile metadata by default
  • [kemonoparty:discord] always provide channel_name metadata (#7245)
  • [sexcom] extract date_url metadata (#7239)
  • [subscribestar] extract title metadata (#7219)

Downloaders

  • [ytdl] support processing inline HLS/DASH manifest data (#6379 #7006)

Miscellaneous

  • [aes] simplify block_count calculation
  • [common] add subdomains argument to cookies_check() (#7188)
  • [config] fix using the same key multiple times with apply (#7127)
  • [tests] implement expected failures

v1.29.2

15 Mar 09:00
v1.29.2
063bf06
Compare
Choose a tag to compare

Extractors

Additions

Fixes

  • [civitai] fix/improve query parameter handling (#7138)
  • [facebook] improve date extraction (#7151)
  • [sankaku] update API URLs (#7154 #7155 #7163)
  • [twitter] prevent exception in _extract_components() (#7139)

Improvements

  • [batoto] add domain option (#7174)
  • [furaffinity] extract scraps metadata (#7015)
  • [tiktok] implement audio extraction without yt-dlp
  • [wikimedia] add subcategories option (#2340)

v1.29.1

08 Mar 16:13
v1.29.1
3eba856
Compare
Choose a tag to compare

Extractors

Additions

  • [tenor] add support (#6075)

Fixes

  • [bunkr] update API endpoint (#7097)
  • [erome] fix AttributeError for albums without tags (#7076)
  • [furaffinity] fix artist metadata (#6582 #7115 #7123 #7130)
  • [jpgfish] decrypt file URLs (#7073 #7079 #7109)
  • [sankaku] fix search tag limit check
  • [vsco] fix video extractor (#7113)
  • [vsco] fix extracting videos from /gallery results (#7113)

Improvements

  • [bunkr] add endpoint option (#7097)
  • [danbooru:pool] download posts in pool order, add order-posts option (#7091)
  • [erome:search] recognize all URL query parameters (#7125)
  • [reddit] add selftext option (#7111)
  • [redgifs:search] support /search?query=... URLs (#7118)
  • [sankaku] increase wait time on 429 errors (#7129)
  • [tiktok] improve tiktok-range parsing (#7098)

Downloaders

  • [http] detect Cloudflare/DDoS-Guard challenges (#7066 #7121)
  • warn about invalid subcategory values (#7103 #7119)

v1.29.0

01 Mar 19:13
v1.29.0
71ebbfa
Compare
Choose a tag to compare

Changes

  • build gallery-dl.exe on Windows 10 / Python 3.13 (#6684)
  • provide Windows 7 / Python 3.8 builds as gallery-dl_x86.exe

Extractors

Additions

Fixes

  • [bunkr] decrypt file URLs (#7058 #7070 #7085 #7089 #7090)
  • [chevereto/jpgfish] fix extraction (#7073 #7079)
  • [generic] fix config lookups by subcategory
  • [philomena] fix date values without UTC offset (#6921)
  • [philomena] download full URLs to prevent potential 404 errors (#6922)
  • [pixiv] prevent exceptions during comments extraction (#6965)
  • [reddit] restrict subreddit search results (#7025)
  • [sankaku] fix extraction (#7071 #7072)
  • [subscribestar] fix post extractor (#6582)
  • [twitter] revert generated CSRF token length to 32 characters (#6895)
  • [vipergirls] change default domain to viper.click (#4166)
  • [weebcentral] fix extracting wrong number of chapter pages (#6966)

Improvements

  • [b4k] update domain to arch.b4k.dev (#6955 #6956)
  • [bunkr] update default archive ID format (#6935)
  • [bunkr] provide fallback URLs for 403 download links (#6732 #6972)
  • [bunkr] implement fast --range support (#6985)
  • [furaffinity] use a default delay of 1 second between requests (#7054)
  • [itaku] support gallery section URLs (#6951)
  • [patreon] support /profile/creators URLs
  • [subscribestar] detect and handle redirects (#6916)
  • [twibooru] match URLs with www subdomain (#6903)
  • [twitter] support grok cards content (#7040)
  • [vsco] improve m3u8 handling
  • [weibo] add movies option (#6988)

Metadata

  • [bunkr] extract id_url metadata (#6935)
  • [erome] extract tags metadata (#7076)
  • [issuu] unescape HTML entities
  • [newgrounds] provide comment_html metadata (#7038)
  • [patreon] extract campaign metadata (#6989)

Downloaders

  • implement downloader options per extractor category
  • [http] add sleep-429 option (#6996)
  • [ytdl] support specifying module as filesystem path (#6991)

Archives

  • [archive] implement support for PostgreSQL databases (#6152)
  • [archive] add archive-table option (#6152)

Miscellaneous

  • [aes] handle errors during cryptodome import (#6906)
  • [executables] fix loading certifi SSL certificates (#6393)
  • improve \f format string handling for --print

v1.28.5

28 Jan 14:16
v1.28.5
ba9e479
Compare
Choose a tag to compare

Extractors

Additions

Fixes

  • [4archive] fix TypeError
  • [adultempire] bypass age confirmation check
  • [architizer] fix extraction
  • [artstation] avoid Cloudflare challenges (#5817, #5658, #5564, #5554)
  • [deviantart] prevent crash when accessing premium_folder data (#6873)
  • [fapachi] fix extraction (#6881)
  • [issuu] fix user extractor
  • [kemonoparty] fix username metadata and filtering by tag for /posts URLs (#6833)
  • [mangafox] fix chapter extraction
  • [mangahere] fix chapter extraction
  • [pixiv] fix sanity_level workaround (#4327)
  • [pornpics] fix pagination results from HTML pages
  • [twitter] handle exceptions during file extraction (#6647)
  • [vsco] fix JSONDecodeError (#6887, #6891)
  • [weebcentral] fix extraction (#6860)
  • [xhamster] fix gallery extractor (#6818, #6876)

Improvements

  • [batoto] use chapter_id in default archive IDs (#6835)
  • [e621] support e621.cc and e621.anthro.fr frontend URLs (#6809)
  • [e621] prevent premature pagination end (#6886)
  • [facebook] allow accessing all metadata in directory format strings (#6874)
  • [hiperdex] update domain to hiperdex.com
  • [kemonoparty] enable filtering creator posts by tag (#6833)
  • [khinsider] add covers option (#6844)
  • [komikcast] update domain to komikcast.la
  • [lofter] improve error handling (#6865)
  • [pornpics] avoid redirect when retrieving a gallery page
  • [urlgalleries] support new URL format

Metadata

  • [bunkr] extract better filename metadata (#6824)
  • [hiperdex] fix description metadata
  • [khinsider] extract more album metadata (#6844)
  • [mangaread] fix manga metadata extraction
  • [rule34xyz] fix date and tags metadata
  • [saint] fix metadata of /d/ URLs
  • [toyhouse] fix date, artists, and characters metadata
  • [webtoons] fix username and author_name metadata

Removals

  • [cohost] remove module
  • [fanleaks] remove module
  • [shimmie2] remove tentaclerape.net
  • [szurubooru] remove booru.foalcon.com

Miscellaneous

  • [docs] add nix docs to README (#6606)
  • [path] fix exception when using --rename-to + --no-download (#6861)
  • [release] include scripts/run_tests.py in release tarball (#6856)

v1.28.4

12 Jan 16:26
v1.28.4
6e3f51a
Compare
Choose a tag to compare

Extractors

Additions

Fixes

  • [bunkr] update to new site layout (#6798, #6805)
  • [bunkr] fix ValueError on relative redirects (#6790)
  • [plurk] fix user data extraction and make it non-fatal (#6742)

Improvements

  • [bunkr] support /f/ media URLs
  • [e621] accept tag search URLs with empty tag (#6783)
  • [pixiv] provide fallback URLs (#6762)
  • [wallhaven] extract search[tags] and search[tag_id] metadata (#6772)

Miscellaneous

  • [util] support not splitting value argument when calling contains() (#6773)

v1.28.3

04 Jan 15:46
v1.28.3
7e8ca37
Compare
Choose a tag to compare

Extractors

Additions

  • [civitai] add user-videos extractor (#6644)
  • [szurubooru] support visuabusters.com/booru (#6729)

Fixes

  • [8muses] skip albums without valid permalink (#6717)
  • [batoto] update domains (#6714)
  • [deviantart:tiptap] fix deviation embeds without token
  • [hitomi] fix searches (#6713)
  • [instagram:reels] fix pinned values (#6719)
  • [kemonoparty] handle discord favorites (#6706)
  • [piczel] fix extraction (#6735)
  • [poipiku] fix downloads when post has a warning (#6736)
  • [sankaku] support alphanumeric book/pool IDs (#6757)
  • [subscribestar] fix attachment downloads (#6721, #6724, #6758)
  • [subscribestar] improve content metadata extraction (#6761)
  • [tapas] fix TypeError for locked episodes (#6700)

Improvements

  • [boosty] support file post attachments (#6760)
  • [deviantart:tiptap] support more content block types (#6686)
  • [directlink] use domain as subcategory (#6703)
  • [hitomi] provide search_tags metadata for tag and search results (#6756)
  • [subscribestar] support audio files (#6758)

Miscellaneous

  • [workflows:executables] build with Python 3.13

v1.28.2

20 Dec 18:17
v1.28.2
454f766
Compare
Choose a tag to compare

Extractors

Additions

Fixes

  • [facebook] decode Unicode surrogate pairs in metadata values (#6599)
  • [zerochan] parse API responses manually when receiving invalid JSON (#6632)
  • [zerochan] fix source metadata extraction when not logged in

Improvements

  • [bilibili] extract files from module_top entries (#6687)
  • [bilibili] support /upload/opus URLs (#6687)
  • [bluesky] default to posts timeline when reposts or quoted is enabled (#6583)
  • [common] simplify HTTP error messages
  • [common] detect DDoS-Guard challenge pages
  • [deviantart] improve tiptap markup to HTML conversion (#6686)
    • fix KeyError: 'attrs' for links without href
    • support heading content blocks
    • support strike text markers
  • [instagram] extract date metadata for stories (#6677)
  • [kemonoparty:favorite] support new URL format (#6676)
  • [saint] support saint2.cr URLs (#6692)
  • [tapas] improve extractor hierarchy (#6680)

Options

  • [cohost] add avatar and background options (#6656)

Miscellaneous

  • support * wildcards for parent>child categories, for example reddit>* (#6673)
  • use latest Firefox UA as default user-agent
  • use random unused port for "user-agent": "browser" requests

v1.28.1

07 Dec 17:07
v1.28.1
d7873b9
Compare
Choose a tag to compare

Extractors

Additions

  • [bluesky] add info extractor

Fixes

  • [bluesky] fix exception when encountering non-quote embeds (#6577)
  • [bluesky] unescape search queries (#6579)
  • [common] restore using environment proxy settings by default (#6553, #6609)
  • [common] improve handling of user-agent settings (#6594)
  • [e621] fix TypeError when metadata is enabled (#6587)
  • [gofile] fix website token extraction (#6596)
  • [inkbunny] fix re-login loop (#6618)
  • [instagram] handle empty carousel_media entries (#6595)
  • [kemonoparty] fix o query parameter handling (#6597)
  • [nhentai] fix download URLs (#6620)
  • [readcomiconline] fix chapter extraction (#6070, #6335)
  • [realbooru] fix extraction (#6543)
  • [rule34] fix favorite extraction (#6573)
  • [zerochan] download .webp and .gif files (#6576)

Improvements

  • [hentaicosplays] update domains (#6578)
  • [pixiv:ranking] implement filtering results by content (#6574)
  • [pixiv] include user ID in failed AJAX request warnings (#6581)

Options

  • [patreon] add format-images option (#6569)
  • [zerochan] add extensions option (#6576)