urllib.error.HTTPError: HTTP Error 403: Forbidden #399

NeverAskWhy · 2019-06-06T07:58:49Z

Hi all,

I'm aware that there are some older issues with the same error, howevery I thought I would just give it a try. For some videos (like this one: https://www.youtube.com/watch?v=393C3pr2ioY ) I get a 403 error...others work fine though. Do you know of any workaround for that? I saw this thread in the older issue https://stackoverflow.com/questions/16627227/http-error-403-in-python-3-web-scraping but I'm not good enough in Python to find the right spot to implement it. Any help would be appreciated.

PS: I already updated to the most current version (9.5.0).

Waarbubble · 2019-06-07T12:43:24Z

I am having the same problem, but for me, it is random whether the same youtube link will generate a 403 or not. My current testing links are:
https://www.youtube.com/watch?v=pAgnJDJN4VA&index=117&list=PL3LCt07uiILKduYr52ZMYrE_PvbSuUdZM
https://www.youtube.com/watch?v=t9psCAWrISg&index=136&list=PL3LCt07uiILKduYr52ZMYrE_PvbSuUdZM
I am only trying to download the audio stream.

Nowbob · 2019-06-07T16:30:16Z

It's a hack of a fix, but this is how I've got mine working for now (I'm running in python 2.7, you may need to fiddle depending on your version):
In pytube/request.py:
At line 4 I added:
from urllib2 import Request

And above line 21 (response = urlopen(url)):
req = Request(url, headers = {"User-Agent": "Mozilla/5.0"})

And then replace the line below:
response = urlopen(url)
with:
response = urlopen(req)

Waarbubble · 2019-06-07T17:05:43Z

Just tested the solution, keeps randomly giving 403, and then working again.

NeverAskWhy · 2019-06-07T17:10:17Z

@Waarbubble : you mean you tested @Nowbob's solution?

Waarbubble · 2019-06-07T17:10:32Z

yes
Tested in python 3

Nowbob · 2019-06-07T17:24:06Z

Yeah I was having the same "sometimes it works sometimes it doesn't" problem, but it's the best I could come up with in a short time.

Waarbubble · 2019-06-07T17:26:00Z

It was worth a try.

NeverAskWhy · 2019-06-07T17:28:36Z

I'm doing something wrong...
In line for of request.py:
from urllib import request

then line 22/23:
req = request(url, headers = {"User-Agent": "Mozilla/5.0"})
response = urlopen(req)

now I'm getting this error:

self.watch_html = request.get(url=self.watch_url)

File "C:\Users\janvo\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pytube\request.py", line 22, in get
req = request(url, headers = {"User-Agent": "Mozilla/5.0"})
TypeError: 'module' object is not callable

Waarbubble · 2019-06-07T17:30:18Z

If you are using python 3 the

fourth line needs to be from urllib.request import Request

and then line 22 will need a capital R in request

NeverAskWhy · 2019-06-07T19:21:34Z

Thanks...I changed it now. It's behaving the same way...three times I got the 403-error and then it worked.

hoetaek · 2019-06-11T01:30:45Z

Getting the same error. I tried all the solutions above. And some works and some don't.

danielgordon10 · 2019-06-11T01:37:56Z

This got much more frequent for me today for some reason. The above solutions do not seem to work for the new cases. Example video https://www.youtube.com/watch?v=ZYoUXaU81Gk

rafaelwastaken · 2019-06-11T02:37:45Z

I believe I've managed to fix this by changing &signature= in line 64 of mixins.py to &sig=.

Waarbubble · 2019-06-11T09:57:50Z

The solution works for me, no more random 403

danielgordon10 · 2019-06-11T16:56:12Z

Neither suggested solution fixes my test video https://www.youtube.com/watch?v=ZYoUXaU81Gk

rafaelwastaken · 2019-06-11T17:21:21Z

@danielgordon10 What error are you getting? I just tried downloading that link and it seems to be working with the &sig= fix.

pytube https://www.youtube.com/watch?v=ZYoUXaU81Gk --list
<Stream: itag="43" mime_type="video/webm" res="360p" fps="30fps" vcodec="vp8.0" acodec="vorbis">
<Stream: itag="18" mime_type="video/mp4" res="360p" fps="30fps" vcodec="avc1.42001E" acodec="mp4a.40.2">
<Stream: itag="135" mime_type="video/mp4" res="480p" fps="30fps" vcodec="avc1.4d400b">
<Stream: itag="244" mime_type="video/webm" res="480p" fps="30fps" vcodec="vp9">
<Stream: itag="134" mime_type="video/mp4" res="360p" fps="30fps" vcodec="avc1.4d401e">
<Stream: itag="243" mime_type="video/webm" res="360p" fps="30fps" vcodec="vp9">
<Stream: itag="133" mime_type="video/mp4" res="240p" fps="30fps" vcodec="avc1.4d400c">
<Stream: itag="242" mime_type="video/webm" res="240p" fps="30fps" vcodec="vp9">
<Stream: itag="160" mime_type="video/mp4" res="144p" fps="30fps" vcodec="avc1.4d400b">
<Stream: itag="278" mime_type="video/webm" res="144p" fps="30fps" vcodec="vp9">
<Stream: itag="140" mime_type="audio/mp4" abr="128kbps" acodec="mp4a.40.2">
<Stream: itag="171" mime_type="audio/webm" abr="128kbps" acodec="vorbis">
<Stream: itag="249" mime_type="audio/webm" abr="50kbps" acodec="opus">
<Stream: itag="250" mime_type="audio/webm" abr="70kbps" acodec="opus">
<Stream: itag="251" mime_type="audio/webm" abr="160kbps" acodec="opus">

pytube https://www.youtube.com/watch?v=ZYoUXaU81Gk --itag 251
Мисс Новоуральск 2012.webm | 7446370 bytes

danielgordon10 · 2019-06-11T17:38:38Z

So I am able to get the stream but I can't download it.

import pytube
video_url = 'https://www.youtube.com/watch?v=ZYoUXaU81Gk'
yt = pytube.YouTube(video_url)
streams = yt.streams
streams = (
        streams.filter(progressive=True, custom_filter_functions=[lambda x: x.resolution is not None])
        .order_by("resolution")
        .all()
)
stream = streams[0]
video = stream.download()

Then I get the urllib.error.HTTPError

    video = stream.download()
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/site-packages/pytube/streams.py", line 217, in download
    bytes_remaining = self.filesize
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/site-packages/pytube/streams.py", line 164, in filesize
    headers = request.get(self.url, headers=True)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/site-packages/pytube/request.py", line 22, in get
    response = urlopen(url)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/home/xkcd/miniconda3/envs/video-env/lib/python3.7/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

rafaelwastaken · 2019-06-12T14:59:45Z

I've only used this in CLI before so I'm not sure, my guess would be to check if it's importing the correct one.

danielgordon10 · 2019-06-12T20:04:35Z

It works fine for other videos...

danielgordon10 · 2019-06-13T17:58:30Z

I think I have a working fix now for this and a related issue (#392). It's not pretty, but it seems to get the job done.
in mixins.py

        if ('signature=' in url or 
                ('s' not in stream and 
                 ('&sig=' in url or '&lsig=' in url))):
            # For certain videos, YouTube will just provide them pre-signed, in
            # which case there's no real magic to download them and we can skip
            # the whole signature descrambling entirely.
            logger.debug('signature found, skip decipher')
            continue

        if js is not None:
            signature = cipher.get_signature(js, stream['s'])
        else:
            # signature not present in url (line 33), need js to descramble
            # TypeError caught in __main__
            raise TypeError('JS is None')

        logger.debug(
            'finished descrambling signature for itag=%s\n%s',
            stream['itag'], pprint.pformat(
                {
                    's': stream['s'],
                    'signature': signature,
                }, indent=2,
            ),
        )
        stream_manifest[i]['url'] = url + '&sig=' + signature

rsistema · 2019-06-17T17:23:59Z

I believe I've managed to fix this by changing &signature= in line 64 of mixins.py to &sig=.

I tried the first fix from @Nowbob, but the problem persisted.
Change the line 64 as you said and now it's working again. Perfectly on Python 2.7

t4ke0 · 2019-06-18T19:17:39Z

still have that error !?

genesysvip · 2019-06-27T05:16:43Z

I think I have a working fix now for this and a related issue (#392). It's not pretty, but it seems to get the job done.
in mixins.py

        if ('signature=' in url or 
                ('s' not in stream and 
                 ('&sig=' in url or '&lsig=' in url))):
            # For certain videos, YouTube will just provide them pre-signed, in
            # which case there's no real magic to download them and we can skip
            # the whole signature descrambling entirely.
            logger.debug('signature found, skip decipher')
            continue

        if js is not None:
            signature = cipher.get_signature(js, stream['s'])
        else:
            # signature not present in url (line 33), need js to descramble
            # TypeError caught in __main__
            raise TypeError('JS is None')

        logger.debug(
            'finished descrambling signature for itag=%s\n%s',
            stream['itag'], pprint.pformat(
                {
                    's': stream['s'],
                    'signature': signature,
                }, indent=2,
            ),
        )
        stream_manifest[i]['url'] = url + '&sig=' + signature

It's work thank you!
But I modify two file mixins.py & cipher.py
% mixins.py
ref #402
if ('signature=' in url) or ('&sig=' in url) or ('&lsig=' in url):
to
if ('signature=' in url or
('s' not in stream and
('&sig=' in url or '&lsig=' in url))):

and

stream_manifest[i]['url'] = url + '&signature=' + signature
to
stream_manifest[i]['url'] = url + '&sig=' + signature

and change pattern in cipher.py
pattern = [
r'yt.akamaized.net/)\s*||\s*'
r'.?\sc\s*&&\sd.set([^,]+\s,\s*(?:encodeURIComponent'
r'\s*()?(?P[a-zA-Z0-9$]+)(',
r'.sig||(?P[a-zA-Z0-9$]+)(',
r'\bc\s*&&\sd.set([^,]+\s,\s*(?:encodeURIComponent'
r'\s*()?(?P[a-zA-Z0-9$]+)(',
]
to
pattern = [
r'\b[cs]\s*&&\s*[adf].set([^,]+\s*,\sencodeURIComponent\s(\s*(?P[a-zA-Z0-9$]+)(',
r'\b[a-zA-Z0-9]+\s*&&\s*[a-zA-Z0-9]+.set([^,]+\s*,\sencodeURIComponent\s(\s*(?P[a-zA-Z0-9$]+)(',
r'(?P[a-zA-Z0-9$]+)\s*=\sfunction(\sa\s*)\s*{\sa\s=\sa.split(\s""\s*)',
r'(["'])signature\1\s*,\s*(?P[a-zA-Z0-9$]+)(',
r'.sig||(?P[a-zA-Z0-9$]+)(',
r'yt.akamaized.net/)\s*||\s*.?\s[cs]\s*&&\s*[adf].set([^,]+\s*,\s*(?:encodeURIComponent\s*()?\s*'
r'(?P[a-zA-Z0-9$]+)(',
r'\b[cs]\s*&&\s*[adf].set([^,]+\s*,\s*(?P[a-zA-Z0-9$]+)(',
r'\b[a-zA-Z0-9]+\s*&&\s*[a-zA-Z0-9]+.set([^,]+\s*,\s*(?P[a-zA-Z0-9$]+)(',
r'\bc\s*&&\sa.set([^,]+\s,\s*([^)])\s(\s*(?P[a-zA-Z0-9$]+)(',
r'\bc\s*&&\s*[a-zA-Z0-9]+.set([^,]+\s*,\s*([^)])\s(\s*(?P[a-zA-Z0-9$]+)(',
r'\bc\s*&&\s*[a-zA-Z0-9]+.set([^,]+\s*,\s*([^)])\s(\s*(?P[a-zA-Z0-9$]+)('
]

I forget this issue number, someone can help me to link?
work on python 3.6, pytube 9.5.0, urllib3 1.25.3

snwfdhmp · 2019-08-26T08:30:31Z

I tried for 15 minutes before realising that : for the mixins.py fix, you have to replace the whole snippet, not just replace signature to sig.

Now it works, thanks a lot !

ogspeace · 2019-08-27T08:24:30Z

With 9.5.1 (the latest downloaded) I tinkered with all the fixes from this thread and finally got it working. There are two separate issues that i had to tackle:

1. KeyError:['title'] and

2. "403: Forbidden"

1)FIrst one to solve was the KeyError:['title']
For some reason the 'title' key is not retrieved anymore in the root of the player_config_args dictionary, hence the error. Upon debugging of the req/reply I found It is instead present in "player_response/videoDetails/title", so edit main.py:

def title(self):
        #Get the video title.

        #:rtype: str

        try:
                tt1 = self.player_config_args['title']
        except:
                tt1 = self.player_config_args.get('player_response', {}).get('videoDetails', {}).get('title')
        finally:
                if not tt1:
                        tt1 = "Unknown YTube video"
        return tt1

and streams.py:

    def default_filename(self):
        """Generate filename based on the video title.

        :rtype: str
        :returns:
            An os file system compatible filename.
        """
        try:
                title = self.player_config_args['title']
        except:
                title = self.player_config_args.get('player_response', {}).get('videoDetails', {}).get('title')
        finally:
                if not title:
                        title = "Unknown YTube video"
        filename = safe_filename(title)
        return '{filename}.{s.subtype}'.format(filename=filename, s=self)

I did also apply the fix found in this thread to request.py about the Agent-User:
from urllib2 import Request
and

req = Request(url, headers = {"User-Agent": "Mozilla/5.0"})
    #response = urlopen(url)
    response = urlopen(req)

2)For the "403 Forbidden" I applied first the suggestion about mixins.py in the apply_signature function:

         if ('signature=' in url or
                ('s' not in stream and
                ('&sig=' in url or '&lsig=' in url))):

            # For certain videos, YouTube will just provide them pre-signed, in
            # which case there's no real magic to download them and we can skip
            # the whole signature descrambling entirely.
            logger.debug('signature found, skip decipher')
            continue

        if js is not None:
            signature = cipher.get_signature(js, stream['s'])
        else:
            # signature not present in url (line 33), need js to descramble
            # TypeError caught in __main__
            raise TypeError('JS is None')

        logger.debug(
            'finished descrambling signature for itag=%s\n%s',
            stream['itag'], pprint.pformat(
                {
                    's': stream['s'],
                    'signature': signature,
                }, indent=2,
            ),
        )
        stream_manifest[i]['url'] = url + '&sig=' + signature

then in the cipher.py I replaced the regex pattern as suggested in another post of this thread:

pattern = [
        r'\b[cs]\s*&&\s*[adf]\.set\([^,]+\s*,\s*encodeURIComponent\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\b[a-zA-Z0-9]+\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*encodeURIComponent\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'(?P<sig>[a-zA-Z0-9$]+)\s*=\s*function\(\s*a\s*\)\s*{\s*a\s*=\s*a\.split\(\s*""\s*\)',
        r'(["\'])signature\1\s*,\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\.sig\|\|(?P<sig>[a-zA-Z0-9$]+)\(',
        r'yt\.akamaized\.net/\)\s*\|\|\s*.*?\s*[cs]\s*&&\s*[adf]\.set\([^,]+\s*,\s*(?:encodeURIComponent\s*\()?\s*(?P<si$',
        r'\b[cs]\s*&&\s*[adf]\.set\([^,]+\s*,\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\b[a-zA-Z0-9]+\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\bc\s*&&\s*a\.set\([^,]+\s*,\s*\([^)]*\)\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\bc\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*\([^)]*\)\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\bc\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*\([^)]*\)\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\('
    ]

@gitethis 's solutions work, and tried it on my scripts, however, here's a slight tweak for python3 users:

in request.py instead of: from urllib2 import Request

use this: from urllib.request import Request

/ogs

jrial · 2019-08-27T10:43:33Z

Seeing as how this appears to be solved with the changes described in various comments, did anyone create a pull request already? I noticed one while quickly scanning this issue, but that one's CI tests failed.

Algomorph · 2019-09-08T21:18:46Z

@jrial ,

Unfortunately, I seem to have applied all the fixes so helpfully summarized by @ogspeace, and I'm still getting "urllib.error.HTTPError: HTTP Error 403: Forbidden"

halfendt · 2019-09-12T22:05:35Z

Thank you! Works for me as well on Python 3.6.5, urllib3 1.25.3, and PyTube 9.5.1.

To summarize the patches needed:

mixins.py - patch by @danielgordon10 in #399 (comment)

cipher.py - edit of @GravelCZ's patch by @nhatton96 at the bottom of #399 (comment)

This also worked very well for me.

xyang5987 · 2019-09-16T04:07:43Z

I changed both mixins.py and cipher.py, but I still got HTTPError: Forbidden

xyang5987 · 2019-09-16T04:10:14Z

I use Python 3.7 and pytube 9.5.2 with win 10.

Algomorph · 2019-09-18T14:46:02Z

Thank you! Works for me as well on Python 3.6.5, urllib3 1.25.3, and PyTube 9.5.1.

To summarize the patches needed:

mixins.py - patch by @danielgordon10 in #399 (comment)

cipher.py - edit of @GravelCZ's patch by @nhatton96 at the bottom of #399 (comment)

I tried this in Windows 10, and it did finally work. Python 3.7.4, PyTube 9.5.2 with the above 2 patches. I also had to apply the title retrieval patch in main.py and streams.py as outlined by @ogspeace. Did not have to mess with urllib for whatever reason, but maybe just got lucky on the ~50 videos I've tried.

gittethis · 2019-09-18T15:02:17Z

I use Python 3.7 and pytube 9.5.2 with win 10.

did you use also my patches on "title" retrieval for main.py and streams.py, as outlined and confirmed by @ogspeace ?

Algomorph · 2019-09-18T15:37:01Z

To keep things clear here, the 'title' retrieval patches fixed a separate issue, e.g. using you_tube_object.video after it's been created. It doesn't affect the "HTTPError: Forbidden" issue, and as such should be kept in a separate PR.

eyobofficial · 2019-09-26T00:34:31Z

For me, the errors are not occurring randomly. They always seem to occur when I attempt to download music videos.

santoslopes · 2019-10-19T18:48:02Z

Not working
It seems to be a good option to download youtube contents but no support, therefore let's look after other options.

MrSlagovich · 2019-11-02T14:46:34Z

I think I have a working fix now for this and a related issue (#392). It's not pretty, but it seems to get the job done.
in mixins.py

        if ('signature=' in url or 
                ('s' not in stream and 
                 ('&sig=' in url or '&lsig=' in url))):
            # For certain videos, YouTube will just provide them pre-signed, in
            # which case there's no real magic to download them and we can skip
            # the whole signature descrambling entirely.
            logger.debug('signature found, skip decipher')
            continue

        if js is not None:
            signature = cipher.get_signature(js, stream['s'])
        else:
            # signature not present in url (line 33), need js to descramble
            # TypeError caught in __main__
            raise TypeError('JS is None')

        logger.debug(
            'finished descrambling signature for itag=%s\n%s',
            stream['itag'], pprint.pformat(
                {
                    's': stream['s'],
                    'signature': signature,
                }, indent=2,
            ),
        )
        stream_manifest[i]['url'] = url + '&sig=' + signature

How do i find this mixins py file?

YashKarthik · 2019-12-03T13:17:04Z

I tried @Nowbob fix but does'nt work, it says Request not defined.

gittethis · 2019-12-03T13:41:28Z

You’re missing the Request module in your python installation. Sent with the great iPhone

…

On 3 Dec 2019, at 15:17, Yash ***@***.***> wrote: I tried @Nowbob fix but does'nt work, it says Request not defined. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

hbmartin · 2020-02-06T15:00:33Z

@YashKarthik @gittethis fixed in pytube3: https://github.com/hbmartin/pytube3/

yijun-li-20 · 2020-02-09T09:50:37Z

Cannot work with the solutions in this thread
Probably because of copyright?

Mac OS Mojave, Python 3.7

hbmartin · 2020-02-09T16:40:15Z

@yijun-li-20 what url are you looking at? what version of pytube are you using?

makesnosense · 2020-03-29T18:51:48Z

hi, pytube3 9.6.4 get urllib.error.HTTPError: HTTP Error 403: Forbidden on this video:
https://www.youtube.com/watch?v=yEG2VTHS9yg

aulorbe · 2020-05-05T19:35:24Z

Where is the mixins.py file in urllib3?

amitbirajdar · 2020-08-01T14:16:22Z

I am using Python3 and the following changes worked for me:

So, you basically study the structure of your URL. In my case since I'm working with Youtube Data API and hence a sample URL for me looked like:

https://www.googleapis.com/youtube/v3/videos?part=snippet&id=8SbUC-UaAxE&key=AIzaSyAVtcurxxUyQznBtLU5UmxqrRSENZ6gAIA

I used the urllib.parse library and then generated the above URL using the strategy below:

params = {'part':'snippet','id':VIDEO_KEY_goes_here', 'key':'YOUR_API_KEY_goes_here'}
querystring = urllib.parse.urlencode(params)
stats_url = 'https://www.googleapis.com/youtube/v3/videos'+'?'+querystring

github-actions · 2020-09-30T18:16:40Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

cha1m · 2021-03-25T00:01:45Z

With 9.5.1 (the latest downloaded) I tinkered with all the fixes from this thread and finally got it working. There are two separate issues that i had to tackle:

KeyError:['title'] and
"403: Forbidden"

1)FIrst one to solve was the KeyError:['title']
For some reason the 'title' key is not retrieved anymore in the root of the player_config_args dictionary, hence the error. Upon debugging of the req/reply I found It is instead present in "player_response/videoDetails/title", so edit main.py:

def title(self):
        #Get the video title.

        #:rtype: str

        try:
                tt1 = self.player_config_args['title']
        except:
                tt1 = self.player_config_args.get('player_response', {}).get('videoDetails', {}).get('title')
        finally:
                if not tt1:
                        tt1 = "Unknown YTube video"
        return tt1

and streams.py:

    def default_filename(self):
        """Generate filename based on the video title.

        :rtype: str
        :returns:
            An os file system compatible filename.
        """
        try:
                title = self.player_config_args['title']
        except:
                title = self.player_config_args.get('player_response', {}).get('videoDetails', {}).get('title')
        finally:
                if not title:
                        title = "Unknown YTube video"
        filename = safe_filename(title)
        return '{filename}.{s.subtype}'.format(filename=filename, s=self)

I did also apply the fix found in this thread to request.py about the Agent-User:
from urllib2 import Request
and

req = Request(url, headers = {"User-Agent": "Mozilla/5.0"})
    #response = urlopen(url)
    response = urlopen(req)

2)For the "403 Forbidden" I applied first the suggestion about mixins.py in the apply_signature function:

         if ('signature=' in url or
                ('s' not in stream and
                ('&sig=' in url or '&lsig=' in url))):

            # For certain videos, YouTube will just provide them pre-signed, in
            # which case there's no real magic to download them and we can skip
            # the whole signature descrambling entirely.
            logger.debug('signature found, skip decipher')
            continue

        if js is not None:
            signature = cipher.get_signature(js, stream['s'])
        else:
            # signature not present in url (line 33), need js to descramble
            # TypeError caught in __main__
            raise TypeError('JS is None')

        logger.debug(
            'finished descrambling signature for itag=%s\n%s',
            stream['itag'], pprint.pformat(
                {
                    's': stream['s'],
                    'signature': signature,
                }, indent=2,
            ),
        )
        stream_manifest[i]['url'] = url + '&sig=' + signature

then in the cipher.py I replaced the regex pattern as suggested in another post of this thread:

pattern = [
        r'\b[cs]\s*&&\s*[adf]\.set\([^,]+\s*,\s*encodeURIComponent\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\b[a-zA-Z0-9]+\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*encodeURIComponent\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'(?P<sig>[a-zA-Z0-9$]+)\s*=\s*function\(\s*a\s*\)\s*{\s*a\s*=\s*a\.split\(\s*""\s*\)',
        r'(["\'])signature\1\s*,\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\.sig\|\|(?P<sig>[a-zA-Z0-9$]+)\(',
        r'yt\.akamaized\.net/\)\s*\|\|\s*.*?\s*[cs]\s*&&\s*[adf]\.set\([^,]+\s*,\s*(?:encodeURIComponent\s*\()?\s*(?P<si$',
        r'\b[cs]\s*&&\s*[adf]\.set\([^,]+\s*,\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\b[a-zA-Z0-9]+\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\bc\s*&&\s*a\.set\([^,]+\s*,\s*\([^)]*\)\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\bc\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*\([^)]*\)\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\(',
        r'\bc\s*&&\s*[a-zA-Z0-9]+\.set\([^,]+\s*,\s*\([^)]*\)\s*\(\s*(?P<sig>[a-zA-Z0-9$]+)\('
    ]

any chance get your help in privet? on e mail maybe?

fschatbot · 2023-04-30T05:18:44Z

This issue is still persistent to this date and what's more is that the mixin.py/ciper.py files are missing. If anybody has a solution for the current date then please do help.

Here is the video I am consistently getting errors with: https://youtube.com/watch?v=56tBagXBH5A

I was suggested to switch from ANDROID to WEB but it still doesn't work!

gxosty · 2023-09-17T15:26:29Z

Hello. So for some reason for me HTTP Error 403 Forbidden happens when opening the same stream url twice. I have checked with pytube-cli. The first time url is getting opened when getting stream.filesize stream property to print Video Title | filesize. And the second time it requests the same url to download video. That leads to 403 Forbidden.

This was referenced Jun 11, 2019

The stream is empty since today. Alexa accept the command and make the response correctly but nothing is to hear ndg63276/alexa-youtube#74

Closed

cant find any enabled video skills ndg63276/alexa-youtube#72

Closed

FearlessENT mentioned this issue Jun 18, 2019

NameError: name 'pytube' is not defined #404

Closed

MarcBresson mentioned this issue Jun 27, 2019

HTTP Error 403: Forbidden #414

Closed

This was referenced Jun 29, 2019

Pytube don't works with some videos #413

Closed

Regex Pattern #416

Closed

403 error #407

Closed

VanDenHendeSimon referenced this issue in VanDenHendeSimon/youtube-downloader Oct 28, 2019

changes to pytube scripts

67b0b41

github-actions bot added the stat: stale label Sep 30, 2020

github-actions bot closed this as completed Oct 7, 2020

shivam-grover mentioned this issue Apr 19, 2022

[BUG] HTTP ERROR 403 for official music videos (hint : download URLs are not reusable if the geolocation of the device is changed) #1294

Closed

emcf mentioned this issue May 4, 2024

[BUG] urllib.error.HTTPError: HTTP Error 403: Forbidden #1916

Open

urllib.error.HTTPError: HTTP Error 403: Forbidden #399

urllib.error.HTTPError: HTTP Error 403: Forbidden #399

Comments

NeverAskWhy commented Jun 6, 2019

Waarbubble commented Jun 7, 2019

Nowbob commented Jun 7, 2019

Waarbubble commented Jun 7, 2019

NeverAskWhy commented Jun 7, 2019

Waarbubble commented Jun 7, 2019 • edited Loading

Nowbob commented Jun 7, 2019

Waarbubble commented Jun 7, 2019

NeverAskWhy commented Jun 7, 2019

Waarbubble commented Jun 7, 2019

NeverAskWhy commented Jun 7, 2019

hoetaek commented Jun 11, 2019

danielgordon10 commented Jun 11, 2019

rafaelwastaken commented Jun 11, 2019

Waarbubble commented Jun 11, 2019

danielgordon10 commented Jun 11, 2019 • edited Loading

rafaelwastaken commented Jun 11, 2019 • edited Loading

danielgordon10 commented Jun 11, 2019

rafaelwastaken commented Jun 12, 2019

danielgordon10 commented Jun 12, 2019

danielgordon10 commented Jun 13, 2019

rsistema commented Jun 17, 2019

t4ke0 commented Jun 18, 2019

genesysvip commented Jun 27, 2019

snwfdhmp commented Aug 26, 2019

ogspeace commented Aug 27, 2019 • edited Loading

jrial commented Aug 27, 2019

Algomorph commented Sep 8, 2019

halfendt commented Sep 12, 2019

xyang5987 commented Sep 16, 2019

xyang5987 commented Sep 16, 2019

Algomorph commented Sep 18, 2019

gittethis commented Sep 18, 2019

Algomorph commented Sep 18, 2019

eyobofficial commented Sep 26, 2019

santoslopes commented Oct 19, 2019

MrSlagovich commented Nov 2, 2019

YashKarthik commented Dec 3, 2019

gittethis commented Dec 3, 2019 via email

hbmartin commented Feb 6, 2020

yijun-li-20 commented Feb 9, 2020

hbmartin commented Feb 9, 2020

makesnosense commented Mar 29, 2020

aulorbe commented May 5, 2020

amitbirajdar commented Aug 1, 2020

github-actions bot commented Sep 30, 2020

cha1m commented Mar 25, 2021

fschatbot commented Apr 30, 2023

gxosty commented Sep 17, 2023

Waarbubble commented Jun 7, 2019 •

edited

Loading

danielgordon10 commented Jun 11, 2019 •

edited

Loading

rafaelwastaken commented Jun 11, 2019 •

edited

Loading

ogspeace commented Aug 27, 2019 •

edited

Loading