Skip to content

iniself/igot

Repository files navigation

igot

Declare: igot forked from you-get. Just fix some bug and change application name, so more detail you can refer you-get site


NOTICE (30 May 2022): Support for Python 3.5, 3.6 and 3.7 will eventually be dropped. (see details here)

NOTICE (8 Mar 2019): Read this if you are looking for the conventional "Issues" tab.


igot is a tiny command-line utility to download media contents (videos, audios, images) from the Web, in case there is no other handy way to do it.

Here's how you use igot to download a video from YouTube:

$ igot 'https://www.youtube.com/watch?v=jNQXAC9IVRw'
site:                YouTube
title:               Me at the zoo
stream:
    - itag:          43
      container:     webm
      quality:       medium
      size:          0.5 MiB (564215 bytes)
    # download-with: igot --itag=43 [URL]

Downloading Me at the zoo.webm ...
 100% (  0.5/  0.5MB) ├██████████████████████████████████┤[1/1]    6 MB/s

Saving Me at the zoo.en.srt ... Done.

And here's why you might want to use it:

  • You enjoyed something on the Internet, and just want to download them for your own pleasure.
  • You watch your favorite videos online from your computer, but you are prohibited from saving them. You feel that you have no control over your own computer. (And it's not how an open Web is supposed to work.)
  • You want to get rid of any closed-source technology or proprietary JavaScript code, and disallow things like Flash running on your computer.
  • You are an adherent of hacker culture and free software.

What igot can do for you:

  • Download videos / audios from popular websites such as YouTube, Youku, Niconico, and a bunch more. (See the full list of supported sites)
  • Stream an online video in your media player. No web browser, no more ads.
  • Download images (of interest) by scraping a web page.
  • Download arbitrary non-HTML contents, i.e., binary files.

Interested? Install it now and get started by examples.

Are you a Python programmer? Then check out the source and fork it!

Installation

Prerequisites

The following dependencies are recommended:

Option 1: Install via pip

The official release of igot is distributed on PyPI, and can be installed easily from a PyPI mirror via the pip package manager. Note that you must use the Python 3 version of pip:

$ pip3 install igot

Option 2: Install via Antigen (for Zsh users)

Add the following line to your .zshrc:

antigen bundle iniself/igot

Option 3: Download from GitHub

You may either download the stable (identical with the latest release on PyPI) or the develop (more hotfixes, unstable features) branch of igot. Unzip it, and put the directory containing the igot script into your PATH.

Alternatively, run

$ [sudo] python3 setup.py install

Or

$ python3 setup.py install --user

to install igot to a permanent path.

You can also use the pipenv to install the igot in the Python virtual environment.

$ pipenv install -e .
$ pipenv run igot --version
igot: version 0.4.1555, a tiny downloader that scrapes the web.

Option 4: Git clone

This is the recommended way for all developers, even if you don't often code in Python.

$ git clone https://github.com/iniself/igot.git

Then put the cloned directory into your PATH, or run ./setup.py install to install igot to a permanent path.

Shell completion

Completion definitions for Bash, Fish and Zsh can be found in contrib/completion. Please consult your shell's manual for how to take advantage of them.

Upgrading

Based on which option you chose to install igot, you may upgrade it via:

$ pip3 install --upgrade igot

or download the latest release via:

$ igot https://github.com/iniself/igot/archive/master.zip

In order to get the latest develop branch without messing up the PIP, you can try:

$ pip3 install --upgrade git+https://github.com/iniself/igot@develop

Getting Started

Download a video

When you get a video of interest, you might want to use the --info/-i option to see all available quality and formats:

$ igot -i 'https://www.youtube.com/watch?v=jNQXAC9IVRw'
site:                YouTube
title:               Me at the zoo
streams:             # Available quality and codecs
    [ DASH ] ____________________________________
    - itag:          242
      container:     webm
      quality:       320x240
      size:          0.6 MiB (618358 bytes)
    # download-with: igot --itag=242 [URL]

    - itag:          395
      container:     mp4
      quality:       320x240
      size:          0.5 MiB (550743 bytes)
    # download-with: igot --itag=395 [URL]

    - itag:          133
      container:     mp4
      quality:       320x240
      size:          0.5 MiB (498558 bytes)
    # download-with: igot --itag=133 [URL]

    - itag:          278
      container:     webm
      quality:       192x144
      size:          0.4 MiB (392857 bytes)
    # download-with: igot --itag=278 [URL]

    - itag:          160
      container:     mp4
      quality:       192x144
      size:          0.4 MiB (370882 bytes)
    # download-with: igot --itag=160 [URL]

    - itag:          394
      container:     mp4
      quality:       192x144
      size:          0.4 MiB (367261 bytes)
    # download-with: igot --itag=394 [URL]

    [ DEFAULT ] _________________________________
    - itag:          43
      container:     webm
      quality:       medium
      size:          0.5 MiB (568748 bytes)
    # download-with: igot --itag=43 [URL]

    - itag:          18
      container:     mp4
      quality:       small
    # download-with: igot --itag=18 [URL]

    - itag:          36
      container:     3gp
      quality:       small
    # download-with: igot --itag=36 [URL]

    - itag:          17
      container:     3gp
      quality:       small
    # download-with: igot --itag=17 [URL]

By default, the one on the top is the one you will get. If that looks cool to you, download it:

$ igot 'https://www.youtube.com/watch?v=jNQXAC9IVRw'
site:                YouTube
title:               Me at the zoo
stream:
    - itag:          242
      container:     webm
      quality:       320x240
      size:          0.6 MiB (618358 bytes)
    # download-with: igot --itag=242 [URL]

Downloading Me at the zoo.webm ...
 100% (  0.6/  0.6MB) ├██████████████████████████████████████████████████████████████████████████████┤[2/2]    2 MB/s
Merging video parts... Merged into Me at the zoo.webm

Saving Me at the zoo.en.srt ... Done.

(If a YouTube video has any closed captions, they will be downloaded together with the video file, in SubRip subtitle format.)

Or, if you prefer another format (mp4), just use whatever the option igot shows to you:

$ igot --itag=18 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Note:

  • At this point, format selection has not been generally implemented for most of our supported sites; in that case, the default format to download is the one with the highest quality.
  • ffmpeg is a required dependency, for downloading and joining videos streamed in multiple parts (e.g. on some sites like Youku), and for YouTube videos of 1080p or high resolution.
  • If you don't want igot to join video parts after downloading them, use the --no-merge/-n option.

Download anything else

If you already have the URL of the exact resource you want, you can download it directly with:

$ igot https://stallman.org/rms.jpg
Site:       stallman.org
Title:      rms
Type:       JPEG Image (image/jpeg)
Size:       0.06 MiB (66482 Bytes)

Downloading rms.jpg ...
100.0% (  0.1/0.1  MB) ├████████████████████████████████████████┤[1/1]  127 kB/s

Otherwise, igot will scrape the web page and try to figure out if there's anything interesting to you:

$ igot https://kopasas.tumblr.com/post/69361932517
Site:       Tumblr.com
Title:      kopasas
Type:       Unknown type (None)
Size:       0.51 MiB (536583 Bytes)

Site:       Tumblr.com
Title:      tumblr_mxhg13jx4n1sftq6do1_1280
Type:       Portable Network Graphics (image/png)
Size:       0.51 MiB (536583 Bytes)

Downloading tumblr_mxhg13jx4n1sftq6do1_1280.png ...
100.0% (  0.5/0.5  MB) ├████████████████████████████████████████┤[1/1]   22 MB/s

Note:

  • This feature is an experimental one and far from perfect. It works best on scraping large-sized images from popular websites like Tumblr and Blogger, but there is really no universal pattern that can apply to any site on the Internet.

Search on Google Videos and download

You can pass literally anything to igot. If it isn't a valid URL, igot will do a Google search and download the most relevant video for you. (It might not be exactly the thing you wish to see, but still very likely.)

$ igot "Richard Stallman eats"

Pause and resume a download

You may use Ctrl+C to interrupt a download.

A temporary .download file is kept in the output directory. Next time you run igot with the same arguments, the download progress will resume from the last session. In case the file is completely downloaded (the temporary .download extension is gone), igot will just skip the download.

To enforce re-downloading, use the --force/-f option. (Warning: doing so will overwrite any existing file or temporary file with the same name!)

Set the path and name of downloaded file

Use the --output-dir/-o option to set the path, and --output-filename/-O to set the name of the downloaded file:

$ igot -o ~/Videos -O zoo.webm 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Tips:

  • These options are helpful if you encounter problems with the default video titles, which may contain special characters that do not play well with your current shell / operating system / filesystem.
  • These options are also helpful if you write a script to batch download files and put them into designated folders with designated names.

Proxy settings

You may specify an HTTP proxy for igot to use, via the --http-proxy/-x option:

$ igot -x 127.0.0.1:8087 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

However, the system proxy setting (i.e. the environment variable http_proxy) is applied by default. To disable any proxy, use the --no-proxy option.

Tips:

  • If you need to use proxies a lot (in case your network is blocking certain sites), you might want to use igot with proxychains and set alias igot="proxychains -q igot" (in Bash).
  • For some websites (e.g. Youku), if you need access to some videos that are only available in mainland China, there is an option of using a specific proxy to extract video information from the site: --extractor-proxy/-y.

Watch a video

Use the --player/-p option to feed the video into your media player of choice, e.g. mpv or vlc, instead of downloading it:

$ igot -p vlc 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Or, if you prefer to watch the video in a browser, just without ads or comment section:

$ igot -p chromium 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Tips:

  • It is possible to use the -p option to start another download manager, e.g., igot -p uget-gtk 'https://www.youtube.com/watch?v=jNQXAC9IVRw', though they may not play together very well.

Load cookies

Not all videos are publicly available to anyone. If you need to log in your account to access something (e.g., a private video), it would be unavoidable to feed the browser cookies to igot via the --cookies/-c option.

Note:

  • As of now, we are supporting two formats of browser cookies: Mozilla cookies.sqlite and Netscape cookies.txt.

Reuse extracted data

Use --url/-u to get a list of downloadable resource URLs extracted from the page. Use --json to get an abstract of extracted data in the JSON format.

Warning:

  • For the time being, this feature has NOT been stabilized and the JSON schema may have breaking changes in the future.

Supported Sites

Site URL Videos? Images? Audios?
YouTube https://www.youtube.com/
Twitter https://twitter.com/
VK https://vk.com/
Vine https://vine.co/
Vimeo https://vimeo.com/
Veoh https://www.veoh.com/
Tumblr https://www.tumblr.com/
TED https://www.ted.com/
SoundCloud https://soundcloud.com/
SHOWROOM https://www.showroom-live.com/
Pinterest https://www.pinterest.com/
MTV81 https://www.mtv81.com/
Mixcloud https://www.mixcloud.com/
Metacafe https://www.metacafe.com/
Magisto https://www.magisto.com/
Khan Academy https://www.khanacademy.org/
Internet Archive https://archive.org/
Instagram https://instagram.com/
InfoQ https://www.infoq.com/presentations/
Imgur https://imgur.com/
Heavy Music Archive https://www.heavy-music.ru/
Freesound https://www.freesound.org/
Flickr https://www.flickr.com/
FC2 Video https://video.fc2.com/
Facebook https://www.facebook.com/
eHow https://www.ehow.com/
Dailymotion https://www.dailymotion.com/
Coub https://coub.com/
CBS https://www.cbs.com/
Bandcamp https://bandcamp.com/
AliveThai https://alive.in.th/
interest.me https://ch.interest.me/tvn
755
ナナゴーゴー
https://7gogo.jp/
niconico
ニコニコ動画
https://www.nicovideo.jp/
163
网易视频
网易云音乐
https://v.163.com/
https://music.163.com/
56网 https://www.56.com/
AcFun https://www.acfun.cn/
Baidu
百度贴吧
https://tieba.baidu.com/
爆米花网 https://www.baomihua.com/
bilibili
哔哩哔哩
https://www.bilibili.com/
豆瓣 https://www.douban.com/
斗鱼 https://www.douyutv.com/
凤凰视频 https://v.ifeng.com/
风行网 https://www.fun.tv/
iQIYI
爱奇艺
https://www.iqiyi.com/
激动网 https://www.joy.cn/
酷6网 https://www.ku6.com/
酷狗音乐 https://www.kugou.com/
酷我音乐 https://www.kuwo.cn/
乐视网 https://www.le.com/
荔枝FM https://www.lizhi.fm/
懒人听书 https://www.lrts.me/
秒拍 https://www.miaopai.com/
MioMio弹幕网 https://www.miomio.tv/
MissEvan
猫耳FM
https://www.missevan.com/
痞客邦 https://www.pixnet.net/
PPTV聚力 https://www.pptv.com/
齐鲁网 https://v.iqilu.com/
QQ
腾讯视频
https://v.qq.com/
企鹅直播 https://live.qq.com/
Sina
新浪视频
微博秒拍视频
https://video.sina.com.cn/
https://video.weibo.com/
Sohu
搜狐视频
https://tv.sohu.com/
Tudou
土豆
https://www.tudou.com/
阳光卫视 https://www.isuntv.com/
Youku
优酷
https://www.youku.com/
战旗TV https://www.zhanqi.tv/lives
央视网 https://www.cntv.cn/
Naver
네이버
https://tvcast.naver.com/
芒果TV