Support HTTP/2 #416

NghiaTranUIT · 2020-02-26T03:22:49Z

🐶 Brief

At the moment, all intercepted HTTP/HTTPS through Proxyman will be downgraded to HTTP/1.1. We should support HTTP/2 too and implement the HTTP/2 parser correctly.

👑 Criteria

Support h2 ALPN in CocoaAsyncSocket
Determine whether or not the request is HTTP/2
Write HTTP/2 Parser. We could inspired from Apple-Server source
Work with current architecture. HTTP/1.x and HTTP/2

Saklad5 · 2020-04-13T13:38:20Z

Any progress on this?

NghiaTranUIT · 2020-04-13T13:50:01Z

@Saklad5 Sorry, but at the moment, I'm working on Protobuf feature.

When it's done, I will kick start the HTTP/2 since it's crucial to support gRPC feature too 🙌

Saklad5 · 2020-04-29T13:42:40Z

Glad to see the Protobuf feature is done: it’s not something I’m interested in, but it means you might work on this soon.
Once Proxyman can run without downgrading traffic, I think I’ll purchase it. Until then, I can’t really justify running it for long periods of time, which limits its utility.

NghiaTranUIT · 2020-04-29T14:22:25Z

I would like to say that HTTP/2 and HTTP/3 are must-have features of Proxyman, and the progress is really good at the moment 🙌

Protobuf, the first blocker is done, it's time for HTTP/2.

Stay tuned 🌮

Saklad5 · 2020-05-02T04:07:55Z

HTTP/3 isn’t formally accepted yet, so I’d say that’s less of a must-have than HTTP/2. I generally don’t expect things to support draft standards, and I understand it is pretty different.

By the way, does Proxyman do any other downgrading at the moment? Besides forcing HTTP/1, does simply running it affect outgoing traffic at all?

NghiaTranUIT · 2020-05-02T04:44:28Z

At the moment, only HTTPS domains, which enable SSL-Proxying (To see the HTTP Response Content) is downgraded to HTTP/1.

Otherwise, HTTPS (no SSL-Proxying) and HTTP are not, since it's just a proxy server, no interception. Thus, it would keep HTTP/2 or other protocols without changing it.

As there are no reliable HTTP/2 servers on macOS (Swift/Objc) yet, so it's the reason why Proxyman doesn't support HTTP/2 at the first implementation. However, Swift-NIO from Apple is fully supported recently, so I'm planning to rewrite the Proxyman Core with NIO stack.

When 1.23.0 build is out this weekend, I will push HTTP/2 forward 👍

wasder · 2020-11-06T00:23:39Z

Looking forward for gRPC support.
Could be a killer feature, as nothing yet so handy support it.👍

bbuckland · 2021-03-15T22:12:19Z

@NghiaTranUIT sounds like you've made a ton of progress towards this. Could you share where you're at with HTTP/2, specifically to enable gRPC?

NghiaTranUIT · 2021-03-16T01:52:54Z

@bbuckland We're migrating the codebase to HTTP/2 but it hasn't finished yet. I will push it forward soon after the Multiple Filters and Diffing is done 🙌

To workaround and see the gRPC data, you might consider using Atlantis from Proxyman (https://github.com/ProxymanApp/atlantis#2-my-app-use-grpc)

inickt · 2021-06-30T18:47:57Z

Would love to know if there are any updates on this, our backend microservices only talk over HTTP/2 and I would love to use Proxyman + the beta of the reverse proxy feature to improve my backend workflow.

That being said I switched over from Charles this week and it has been amazing for testing iOS things!

NghiaTranUIT · 2021-07-01T01:15:28Z

Thanks for the upvote @inickt. Since the Reverse Proxy is almost done (we're going to release it in this week), so our team is working on the HTTP/2 👍

We will send a Beta build here when it's available 😄

inickt · 2021-09-30T14:32:16Z

Hey, I was curious if there have been any updates on this? Still been loving the app so thanks for all of your work and the great updates!

NghiaTranUIT · 2021-09-30T15:03:20Z

Hey @inickt Thanks for your shoutout.

To be honest, I tried to support HTTP/2 months ago but it doesn't work well since it's a breaking change in our codebase 😿 . The problem is not just supporting HTTP/2, it also includes HTTP/1.1 as backward compatible.

At the moment, I'm focusing on the Folder Rule (where you can organize the tool rules in folders). When it's done, I will back to HTTP/2 👍

NicolasCombe5555 · 2022-07-02T16:42:28Z

Hello @NghiaTranUIT 👍🏻; could we expect http2 support any time soon or not likely to happen soon? Thanks 🤝

NghiaTranUIT · 2022-07-03T01:14:40Z

Sorry @NicolasCombe5555 This ticket is implemented but it's delayed due to technical problems. Basically, in order to support HTTP/2, we have to redesign the ProxymanCore, which is primarily designed for HTTP/1.1. Hence, we decide to postpone this ticket until we found a better solution.

Can you elaborate on why you need HTTP/2? Does it important for your work? @NicolasCombe5555 🤔

NicolasCombe5555 · 2022-07-03T18:30:31Z

@NghiaTranUIT Well part of my project has http/2 in our tech stack; so I cannot see that traffic when using Proxyman. But I understand if we are having issues with supporting it here; thanks for the quick response tho 👍🏻

eseay · 2022-07-15T17:59:44Z

I've read this thread and understand the complexity surrounding adding HTTP/2 support, but I just wanted to more or less throw a "+1" onto this issue as someone who would like to see it supported.

In the meantime, I am just using mitmproxy to view any traffic from my application where HTTP/2 is required.

@NghiaTranUIT to give you some context about the HTTP/2 need - we're starting to use more gRPC across my teams, and since that's HTTP/2, we're not able to proxy those requests using Proxyman. In fact, having Proxyman open when those requests go out essentially breaks them. (I work on the iOS apps, and am debugging that app's traffic to our servers)

Thanks for your work on such a great tool!

NghiaTranUIT · 2022-07-16T01:46:35Z

Even Proxyman can support HTTP/2 and Protobuf, but there is no guarantee that it can capture and properly decrypt the gRPC package because we don't support it yet.

To workaround, @eseay you can use Atlantis, which allows you to capture gPRC traffic 👍 https://github.com/ProxymanApp/atlantis#2-my-app-use-grpc

eseay · 2022-07-16T13:48:11Z

@NghiaTranUIT well I'll clarify that the back-end is serving a gRPC hybrid called Connect, so we're actually just using POST requests with normal request bodies, but those requests require HTTP/2.

In either case - I am curious what I may be doing wrong in Proxyman to not be seeing HTTP/2 traffic.

When I run mitmproxy, I see that all of my requests (both gRPC-Connect and classic REST) are being conducted via HTTP/2; I see the same thing when proxying through Charles.

In Proxyman, when I go to inspect my requests, they are all showing as using HTTP/1.1. Is there something I may have configured incorrectly in Proxyman that's preventing the HTTP/2 transmissions?

j-j-m · 2022-10-12T17:15:12Z

I see the same thing. Is there any way to prevent Proxyman from breaking my gRPC services in app? I have tried Atlantis with no luck.

NghiaTranUIT · 2022-10-13T02:40:23Z

@j-j-m can you use this Atlantis code to capture gRPC traffic? https://github.com/ProxymanApp/atlantis#2-my-app-use-grpc

and open Tools Menu -> SSL Proxying List -> Remove the gRPC domain in the Include List. It will fix the SSL Error, and allows the Atlantis to work properly 👍

NghiaTranUIT · 2023-02-05T14:20:50Z

Good news 🎉 🎉

I've supported the HTTP/2 protocol (Beta) for the Proxyman app 🎉

Beta build: https://proxyman.s3.us-east-2.amazonaws.com/beta/Proxyman_4.1.0_Support_HTTP_2.dmg

What's new

Support HTTP/2 and HTTP/1.1 (can negotiate during the SSL Handshake)
Tested and HTTP/2 work with the following debugging tools:

Breakpoint
Map Local
Scripting
Map Remote
Compose & Edit
Repeat
Block / Allow List
External Proxy
A lot of Unit Tests to cover all cases

Notes

In the HTTP Message (Breakpoint or Map Local), you can use HTTP/1.1 or HTTP/2. It doesn't matter since Proxyman will use the correct HTTP Protocol behind the scenes => It means, you can use your current Map Local Rule/ Breakpoint Raw Message without any problems ✅

Screenshots

How to enable HTTP/2

Open Preference -> Check "Use HTTP/2" -> Restart the app to take effect.

Known issues:

WSS doesn't work over HTTP/2 (WS still works as usual)
???

If you guys find any bugs, please let me know, I'm all ears to fix it 👍

Just a friendly tag: @j-j-m @eseay @NicolasCombe5555 @inickt @bbuckland @Saklad5, @Ashraf-Ali-aa, @julasamer, @wasder, @ildar-gilfanov, @NSMyself, @heyzooi, @inickt, @nxtSwitch, @basecde, water-a

derekmurawsky · 2023-02-05T16:53:22Z

Tested it out, and it looks like it works to me! I was able to request an image where, previously, the connection was downgraded to 1.1. Thank you!

brr53 · 2023-02-05T18:50:39Z

Thank you. There is a bug though. HTTP2 does not have the host header. So this RAW is incorrect. HTTP2 heading should look something like this.

:method: GET
:authority: www.google.com
:scheme: https
:path: /

@NghiaTranUIT

NghiaTranUIT · 2023-02-06T01:01:38Z

Thanks @brr53. It's just a UI bug. Behind the sense, Proxyman automatically translates the HTTP/1.1 Raw format into the HTTP/2 format, so it's still working.

I'm going to fix the Raw Tab for HTTP/2 now 👍

NghiaTranUIT · 2023-04-15T06:38:07Z

Update 8

Beta: https://download.proxyman.io/beta/Proxyman_4.6.1_HTTP_2_v8.dmg
Fix the memory leaks and the Breakpoint doesn't work with HTTP/2
Update from the latest version: 4.6.1

lundstrj · 2023-04-21T13:31:29Z

I went don't a fun rabbit hole related to why my service was falling back to http/1.1 (and breaking) and eventually landed here. Killing the proxy resolved my problem.

Any comment on if/when Proxyman will be able to allow http/3 as well?

NghiaTranUIT · 2023-04-22T01:12:49Z

@lundstrj Not soon yet since the HTTP/2 is still developing (it's 80% now).

NghiaTranUIT · 2023-05-05T00:57:04Z

Update 9:

Beta: https://download.proxyman.io/beta/Proxyman_4.7.1_Support_HTTP_2_Update_v9.dmg
Fix some crashes when doing HTTP/2
Update the latest build 4.7.1, including the Automatic/Manual Setup for NodeJS, Ruby and Python

djtarazona · 2023-06-11T14:59:58Z

Any updates or ETA on HTTP/2 support @NghiaTranUIT? 🙏

djtarazona · 2023-07-21T15:14:12Z

Bump @NghiaTranUIT 🙏

NghiaTranUIT · 2023-07-30T12:16:03Z

@djtarazona Sorry for the late reply. It's still in BETA.

Here is the v10 Update: https://download.proxyman.io/beta/Proxyman_4.9.0_HTTP_2_v10.dmg

Changelog

Map Local & Breakpoint for HTTP/2
Update the latest Proxyman version 4.9.0

lukeadamson · 2023-10-24T16:52:15Z

@NghiaTranUIT Hello! Any update or ETA on HTTP/2 support? I'm still seeing connections be downgraded to HTTP/1.1 when proxied through Proxyman.

The update above indicates that it's still in beta as of Jul 30, but I can't find any mention of it after. Is there a way to access Beta builds of Proxyman?

ekscrypto · 2023-10-24T20:38:34Z

Same here, please make HTTP/2 available to the public

NghiaTranUIT · 2023-10-30T02:56:10Z

Update v11:

Download: https://download.proxyman.io/beta/Proxyman_4.14.0_HTTP_2_v11.dmg
Update with the latest 4.14.0 (Change Logs)

Sorry guys @ekscrypto @lukeadamson , HTTP/2 is still in Beta because there is some technical issue that I haven't found a solution yet. It doesn't satisfy my standards so I decided not to bring it to the public until all issues are resolved.

For example:

Client -> Proxyman: Use WS/WSS with HTTP/2, but Proxyman -> Server uses HTTP/1.1 and vice versa
WS/WSS doesn't work HTTP/2

djtarazona · 2023-10-31T01:55:16Z

Thanks for the context. Appreciate you holding a quality bar.

I don't need WS/WSS, so these betas have been working good for me. I'd appreciate an option to download a build with this HTTP/2 beta for each stable Proxyman release (not sure if the beta build generation is automatic). Or perhaps consider including this feature in stable releases but only opt-in from some preferences pane for beta features.

Thanks a bunch for your work @NghiaTranUIT!

seidnerj · 2024-01-14T15:21:46Z

@NghiaTranUIT any chance to get an up-to-date beta with HTTP2 support? thanks in advance!

seidnerj · 2024-01-14T15:27:49Z

@NghiaTranUIT I'm a bit confused by the HTTP2 support in the builds provided here - does HTTP2 support in Proxyman mean that Proxyman itself will use HTTP2 when connecting to the target server or does it mean that support HTTP2 when receiving incoming traffic, i.e. listening on localhost:9090? or both?

NghiaTranUIT · 2024-01-15T11:55:18Z

does HTTP2 support in Proxyman mean that Proxyman itself will use HTTP2 when connecting to the target server or does it mean that support HTTP2 when receiving incoming traffic

@Saklad5 yes, it's. Proxyman Beta prefers using HTTP/2, and fallback to HTTP/1 if your server doesn't talk HTTP2.

seidnerj · 2024-01-15T16:15:29Z

Okay, but from the client's perspective, the client connecting to proxyman that is, is the connection http2 or http1.1?

NghiaTranUIT · 2024-01-16T01:59:03Z

@Saklad5 Yes, it supports both HTTP/2 and HTTP/1 too, depending on what your client would like to use what protocol for the communication.

NghiaTranUIT · 2024-01-29T03:43:32Z

Update HTTP/2 (BETA) v12 🎉

Download: https://download.proxyman.io/beta/Proxyman_4.16.0_Update_HTTP_2_v12.dmg
Support all changelogs from v4.9.0 to the latest version 4.16.0 (All Changelog)

leberwurstsaft · 2024-02-16T16:18:17Z

Is HTTP2 support also in the 5.0 release?

NghiaTranUIT · 2024-02-19T03:54:19Z

@leberwurstsaft HTTP/2 is still in Beta because the Websocket with HTTP/2 is not completed yet.

Here is the new update with Proxyman v5.0.0:

Beta: https://download.proxyman.io/beta/Proxyman_5.0.0_Support_HTTP_2_v14.dmg
Changelog of v5.0.0: https://github.com/ProxymanApp/Proxyman/releases/tag/5.0.0

Screenshot

Enable HTTP/2 in the Proxy Setting (Proxyman Menu -> Setting -> General Tab -> Proxy Setting)

shrimpwtf · 2024-06-07T08:30:42Z

Is this present in 5.5.0? can only find it in the above version

NicolasCombe5555 · 2024-06-09T06:24:59Z

Sorry I got lost in time!
@NghiaTranUIT amazing progress! ❤️Thank you for your passion on this.
Not trying to rush it but I am just catching up, I saw in the comments you said it was 80% done some time ago, are we near close now? Will test your latest build!

NghiaTranUIT · 2024-06-09T07:47:00Z

@shrimpyuk @NicolasCombe5555 Sorry, the HTTP/2 is not out of Beta yet because I could not solve some HTTP/2 issue with Websocket.

You can try this beta HTTP/2: https://download.proxyman.io/beta/Proxyman_5.5.0_Support_HTTP_2_v15.dmg

Changelog

Support HTTP/2 with all debugging tools (except HTTP/2 with WS)
All features/improvements/bugs fixes from Proxyman 5.5.0 => You can see the changelog at Github Release

elijahdou · 2024-07-01T03:29:07Z

@shrimpyuk @NicolasCombe5555 Sorry, the HTTP/2 is not out of Beta yet because I could not solve some HTTP/2 issue with Websocket.

You can try this beta HTTP/2: https://download.proxyman.io/beta/Proxyman_5.5.0_Support_HTTP_2_v15.dmg

Changelog

Support HTTP/2 with all debugging tools (except HTTP/2 with WS)

All features/improvements/bugs fixes from Proxyman 5.5.0 => You can see the changelog at Github Release

Is there a schedule for when http2.0 will be supported?

NghiaTranUIT · 2024-07-17T04:24:39Z

HTTP/2 v16

Beta: https://download.proxyman.io/beta/Proxyman_5.6.1_Support_HTTP2_v16.dmg
Include everything from v5.6.0 and v5.6.1 (Release Note)
Fix all Memory Leaks from v5.5.0

HTTP/2 v17

Beta: https://download.proxyman.io/beta/Proxyman_5.6.1_Support_HTTP_2_v17.dmg
Fix some crashes on AppCenter

zedd3v · 2024-09-26T23:37:53Z

Updates ? @NghiaTranUIT

NghiaTranUIT · 2024-09-27T03:05:49Z

@zedd3v it's still in Beta.

Update HTTP/2 with Proxyman 5.9.0

heyzooi · 2024-09-27T19:31:32Z

any plans to support HTTP/3?

NghiaTranUIT added the feature It's new feature label Feb 26, 2020

NghiaTranUIT self-assigned this Feb 26, 2020

NghiaTranUIT mentioned this issue Nov 25, 2021

HTTP2 Unsupported #1074

Open

NghiaTranUIT mentioned this issue Feb 5, 2023

Is HTTP 2 supported? #588

Open

NghiaTranUIT added this to the Proxyman 4.3.0 milestone Feb 5, 2023

NghiaTranUIT mentioned this issue May 17, 2023

Failed to load ChatGPT #1638

Open

defagos mentioned this issue Jun 4, 2024

LSVS stream validation SRGSSR/pillarbox-documentation#69

Closed

1 task

NghiaTranUIT mentioned this issue Jul 17, 2024

Crash in Proxyman HTTP/2.0 on close mobile application #2068

Closed

Support HTTP/2 #416

Support HTTP/2 #416

Comments

NghiaTranUIT commented Feb 26, 2020 • edited Loading

🐶 Brief

👑 Criteria

Update 1 (5 Feb 2023): Beta build for HTTP/2 is ready ✅

Update 2 (14 Feb 2023): New Update

Update 3 (22 Feb 2023):

Saklad5 commented Apr 13, 2020

NghiaTranUIT commented Apr 13, 2020

Saklad5 commented Apr 29, 2020

NghiaTranUIT commented Apr 29, 2020

Saklad5 commented May 2, 2020 • edited Loading

NghiaTranUIT commented May 2, 2020

wasder commented Nov 6, 2020 • edited Loading

bbuckland commented Mar 15, 2021

NghiaTranUIT commented Mar 16, 2021

inickt commented Jun 30, 2021

NghiaTranUIT commented Jul 1, 2021

inickt commented Sep 30, 2021

NghiaTranUIT commented Sep 30, 2021

NicolasCombe5555 commented Jul 2, 2022

NghiaTranUIT commented Jul 3, 2022

NicolasCombe5555 commented Jul 3, 2022 • edited Loading

eseay commented Jul 15, 2022

NghiaTranUIT commented Jul 16, 2022

eseay commented Jul 16, 2022

j-j-m commented Oct 12, 2022

NghiaTranUIT commented Oct 13, 2022

NghiaTranUIT commented Feb 5, 2023 • edited Loading

What's new

Notes

Screenshots

How to enable HTTP/2

Known issues:

derekmurawsky commented Feb 5, 2023

brr53 commented Feb 5, 2023 • edited Loading

NghiaTranUIT commented Feb 6, 2023

NghiaTranUIT commented Apr 15, 2023 • edited Loading

Update 8

lundstrj commented Apr 21, 2023

NghiaTranUIT commented Apr 22, 2023

NghiaTranUIT commented May 5, 2023

Update 9:

djtarazona commented Jun 11, 2023 • edited Loading

djtarazona commented Jul 21, 2023

NghiaTranUIT commented Jul 30, 2023 • edited Loading

Changelog

lukeadamson commented Oct 24, 2023

ekscrypto commented Oct 24, 2023

NghiaTranUIT commented Oct 30, 2023

Update v11:

djtarazona commented Oct 31, 2023

seidnerj commented Jan 14, 2024

seidnerj commented Jan 14, 2024

NghiaTranUIT commented Jan 15, 2024

seidnerj commented Jan 15, 2024

NghiaTranUIT commented Jan 16, 2024 • edited Loading

NghiaTranUIT commented Jan 29, 2024

Update HTTP/2 (BETA) v12 🎉

leberwurstsaft commented Feb 16, 2024

NghiaTranUIT commented Feb 19, 2024

Screenshot

shrimpwtf commented Jun 7, 2024

NicolasCombe5555 commented Jun 9, 2024

NghiaTranUIT commented Jun 9, 2024

Changelog

elijahdou commented Jul 1, 2024

Changelog

NghiaTranUIT commented Jul 17, 2024 • edited Loading

HTTP/2 v16

HTTP/2 v17

zedd3v commented Sep 26, 2024

NghiaTranUIT commented Sep 27, 2024

Update HTTP/2 with Proxyman 5.9.0

heyzooi commented Sep 27, 2024

NghiaTranUIT commented Feb 26, 2020 •

edited

Loading

Saklad5 commented May 2, 2020 •

edited

Loading

wasder commented Nov 6, 2020 •

edited

Loading

NicolasCombe5555 commented Jul 3, 2022 •

edited

Loading

NghiaTranUIT commented Feb 5, 2023 •

edited

Loading

brr53 commented Feb 5, 2023 •

edited

Loading

NghiaTranUIT commented Apr 15, 2023 •

edited

Loading

djtarazona commented Jun 11, 2023 •

edited

Loading

NghiaTranUIT commented Jul 30, 2023 •

edited

Loading

NghiaTranUIT commented Jan 16, 2024 •

edited

Loading

NghiaTranUIT commented Jul 17, 2024 •

edited

Loading